2026-04-27 07:53:41 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-27 07:53:41 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-27 07:53:41 [auto1.de] INFO: Starting spider auto1.de
2026-04-27 07:53:41 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-27 07:53:41 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-27 07:53:41 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-27 07:53:41 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-27 07:53:41 [scrapy.extensions.telnet] INFO: Telnet Password: c9b7e99e0bc41062
2026-04-27 07:53:41 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-04-27 07:53:41 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/2026-04-27T07_53_37.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-04-27 07:53:41 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:41 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:53:41 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-27 07:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-27 07:53:41 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-04-27 07:53:41 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-04-27 07:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:53:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2105
2026-04-27 07:53:41 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-27 07:53:41 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-04-27 07:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-04-27 07:53:42 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-04-27 07:53:43 [common.geocoding.geonames_geocoder] INFO: GeoNames geocoder loaded: 9 files, 94519 postal codes, 171568 cities
2026-04-27 07:53:43 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-27 07:53:43 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-04-27 07:53:43 [scrapy.core.engine] INFO: Spider opened
2026-04-27 07:53:43 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-04-27 07:53:43 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-04-27 07:53:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 341MiB
2026-04-27 07:53:43 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:53:43 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:53:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-04-27 07:53:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-04-27 07:53:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-04-27 07:53:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-04-27 07:53:54 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 10547 | hits on page: 40
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: BY28152
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for BY28152: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: BB97907
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for BB97907: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: NG94369
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for NG94369: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: SA28167
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for SA28167: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: PT33622
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for PT33622: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: PH42253
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for PH42253: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: YF65310
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for YF65310: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: CF30803
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for CF30803: 1
2026-04-27 07:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: AM19734
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for AM19734: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: KA37789
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for KA37789: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: TF24039
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for TF24039: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: TS14556
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for TS14556: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: JR08439
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for JR08439: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: KS87596
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for KS87596: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: CC68415
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for CC68415: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: YK83419
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for YK83419: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: EA73737
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for EA73737: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: FZ86660
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for FZ86660: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: TH71338
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for TH71338: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: WD67147
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for WD67147: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: DA35415
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for DA35415: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: YR59159
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for YR59159: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: WE17862
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for WE17862: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: ZU19955
2026-04-27 07:53:54 [auto1.de] INFO: Scrape type for ZU19955: 1
2026-04-27 07:53:54 [auto1.de] INFO: Found listing with ID: CG92624
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for CG92624: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: PT65753
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for PT65753: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: CJ83034
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for CJ83034: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XK84276
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for XK84276: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: WV76032
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for WV76032: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: SZ68842
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for SZ68842: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XH23682
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for XH23682: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GM08023
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for GM08023: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: RL26788
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for RL26788: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: AG72708
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for AG72708: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GL21385
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for GL21385: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XJ18544
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for XJ18544: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: DL59919
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for DL59919: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GM11398
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for GM11398: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: UZ92220
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for UZ92220: 1
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: YP22273
2026-04-27 07:53:55 [auto1.de] INFO: Scrape type for YP22273: 1
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA28167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB97907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH42253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT33622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF65310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG94369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:55 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 10547 | hits on page: 40
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: BY28152
2026-04-27 07:53:55 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BY28152/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: BB97907
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: NG94369
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: SA28167
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: PT33622
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: PH42253
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: YF65310
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: CF30803
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: AM19734
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: KA37789
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: TF24039
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: TS14556
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: JR08439
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: KS87596
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: CC68415
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: YK83419
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: EA73737
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: FZ86660
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: TH71338
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: WD67147
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: DA35415
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: YR59159
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: WE17862
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: ZU19955
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: CG92624
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: PT65753
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: CJ83034
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XK84276
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: WV76032
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: SZ68842
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XH23682
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GM08023
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: RL26788
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: AG72708
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GL21385
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: XJ18544
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: DL59919
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: GM11398
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: UZ92220
2026-04-27 07:53:55 [auto1.de] INFO: Found listing with ID: YP22273
2026-04-27 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY28152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF30803/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM19734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF24039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR08439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS87596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC68415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS14556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP22273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ92220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM11398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA37789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH42253> (referer: https://www.auto1.com/v1/car-details-view/PH42253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496549a9-9e52-58bf-87f1-c4f12a294fc1 with identifier: PH42253
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496549a9-9e52-58bf-87f1-c4f12a294fc1 with scrape type 1
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_be620832a77a5303f9069b3adcd0bff6.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_56ee97313ac31bec6236625b6b92eb35.jpg not downloaded yet
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB97907> (referer: https://www.auto1.com/v1/car-details-view/BB97907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA28167> (referer: https://www.auto1.com/v1/car-details-view/SA28167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_6b5ee827f2a7b06b9f8092af4578b00f.jpg not downloaded yet
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_25074324e132854d9ad26f619e1d8ebf.jpg not downloaded yet
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT33622> (referer: https://www.auto1.com/v1/car-details-view/PT33622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_804cc79c5f78a70dc1ac71ce77769f52.jpg not downloaded yet
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG94369> (referer: https://www.auto1.com/v1/car-details-view/NG94369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_b9008b02a58fada6f579d937a39f9570.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with identifier: BB97907
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with scrape type 1
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_b876321b4581493219b99bd3f67e7170.jpg not downloaded yet
2026-04-27 07:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bddd8bba-032e-5929-a7aa-167b33634d74 with identifier: SA28167
2026-04-27 07:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bddd8bba-032e-5929-a7aa-167b33634d74 with scrape type 1
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_fa00d958211fea7f844f34ae91cfddc3.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_f0ba1ba9fd2e2dd90dd84bf36e8679da.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_7473642febe23b79eadc0b63351d3d8a.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_4c19a48e44c298fd65ee990f6a602596.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_aef8a6a41e59d681c5da9b10725f676c.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_2f3f80006b70392a4752d71e2f640425.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_0aa75cc7e1a61d4bae54afe06fa6f2f8.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2825b7-1499-538f-8225-9ebf52d58424 with identifier: PT33622
2026-04-27 07:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2825b7-1499-538f-8225-9ebf52d58424 with scrape type 1
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3cd4f885de5402695e40d30df3ffea9e.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_98d5ab0541ab0a48ab256e2fcf6c545d.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_21d9aa24708d8fb7949b6e4da8579c5b.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2804aeb22c42223abb24b04f2e26de33.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_ec81b98ea32bd92817e739748b2cefce.jpg not downloaded yet
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF65310> (referer: https://www.auto1.com/v1/car-details-view/YF65310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY28152> (referer: https://www.auto1.com/v1/car-details-view/BY28152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-04-27 07:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with scrape type 1
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_0f7a352d5dbd87629cde4a84c28fd231.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_dc54c76bd5a8c02929578fc8738388b3.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_76dae5dd553078506aec633dcf5e7f0e.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_cd9f85b15e595d699471d1d929712c63.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_9264d1670a5d9a7779570b51bdae0d78.jpg not downloaded yet
2026-04-27 07:53:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b4e46a3e28b73d3f8ffe72f7f3335e23.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_fb44b4c84fbc4c9b1c9fcfea41268609.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_193eace04bd406455419815d8eef5e32.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_2b939ad1b8eae620a4dd9cdd86e07cdf.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_5e36affe8d20a740b3cfb3b2b20068b0.jpg not downloaded yet
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_25074324e132854d9ad26f619e1d8ebf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_56ee97313ac31bec6236625b6b92eb35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_be620832a77a5303f9069b3adcd0bff6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_a74014715b169c2312a97bcc5a61d2ac.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_1d79fb124af7a098de0079b03ee0dd26.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3556f62478ebc3d8436439f2340648bb.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9fdb83-a927-5486-91d4-5795d40c5744 with identifier: YF65310
2026-04-27 07:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9fdb83-a927-5486-91d4-5795d40c5744 with scrape type 1
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c935a7c179765ee4b86a8abe03ed6b8c.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1276fff7-28ab-5969-84ca-458048dc3292 with identifier: BY28152
2026-04-27 07:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1276fff7-28ab-5969-84ca-458048dc3292 with scrape type 1
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_319508f8560433c2c6e5185d811c930c.jpg not downloaded yet
2026-04-27 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_6b5ee827f2a7b06b9f8092af4578b00f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_992674b999df4af19708590ec2740a02.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_5ee36c8cdb5d3860014328963f0b1d82.jpg not downloaded yet
2026-04-27 07:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_ab33a0caf4df80fdf15225f09471aba2.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5a732bdd9b4edae66c1de4b1294c6831.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_ecc2dbc04cd5b482a09c3d45a6c7adbe.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_123131a22ec79432da45d0e2b164685d.jpg not downloaded yet
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM19734> (referer: https://www.auto1.com/v1/car-details-view/AM19734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_193eace04bd406455419815d8eef5e32.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_74699a6817a65ab7d5983bc1c76df4d3.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_42efcf74f29bc4b3dfa23b709616a1eb.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_ccf262cd4897ee3315a796fd6aba7a28.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_aace984ca984f5a6712e999e089b99aa.jpg not downloaded yet
2026-04-27 07:53:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efa250>
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2099
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_25074324e132854d9ad26f619e1d8ebf.jpg saved to cache
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d50b90>
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_56ee97313ac31bec6236625b6b92eb35.jpg saved to cache
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6b450>
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_be620832a77a5303f9069b3adcd0bff6.jpg saved to cache
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_81af4220e4ef7b9da3a2756cb409fa8b.jpg not downloaded yet
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_5e36affe8d20a740b3cfb3b2b20068b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_9e3982759633677492349032396b7936.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2cc4c3fa8839578d011fd4db922ab16a.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_d57b47718cc045e7da8c57babdd94a57.jpg not downloaded yet
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_20a53322934ad335970861b6938734f9.jpg not downloaded yet
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_2b939ad1b8eae620a4dd9cdd86e07cdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_fb44b4c84fbc4c9b1c9fcfea41268609.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_c43d9b933cb23eb51f5f50230240a7ec.jpg not downloaded yet
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR08439> (referer: https://www.auto1.com/v1/car-details-view/JR08439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS87596> (referer: https://www.auto1.com/v1/car-details-view/KS87596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS14556> (referer: https://www.auto1.com/v1/car-details-view/TS14556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF24039> (referer: https://www.auto1.com/v1/car-details-view/TF24039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62a10>
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:53:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_6b5ee827f2a7b06b9f8092af4578b00f.jpg saved to cache
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-04-27 07:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 1
2026-04-27 07:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_1f44b2e2824a5e350e3a5d5220f1af53.jpg not downloaded yet
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9bf50>
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_193eace04bd406455419815d8eef5e32.jpg saved to cache
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c77c78d6272e0cbc5955a4ebf7551c85.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_31b24e31ee84713dba9cfa27c257b908.jpg not downloaded yet
2026-04-27 07:54:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_52489f4fed8359825f25171f4b5427e2.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a2656a1f97ebf23be48f34b2745a2ec3.jpg not downloaded yet
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e85410>
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_5e36affe8d20a740b3cfb3b2b20068b0.jpg saved to cache
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_ecc2dbc04cd5b482a09c3d45a6c7adbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_3ad9383890ccd9bd7a29bd055ecc0d71.jpg not downloaded yet
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bfad0>
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_2b939ad1b8eae620a4dd9cdd86e07cdf.jpg saved to cache
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011da50>
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_fb44b4c84fbc4c9b1c9fcfea41268609.jpg saved to cache
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfe1668b-4ef6-520e-a6fd-7fcece619760 with identifier: JR08439
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe1668b-4ef6-520e-a6fd-7fcece619760 with scrape type 1
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_db482c2576fccb29bc92bb2e21cb7c3b.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with identifier: KS87596
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with scrape type 1
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_be60a3a203d8b9d222806d86e375225e.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7882a5d0-ec77-51f7-9936-79eec56e656d with identifier: TS14556
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7882a5d0-ec77-51f7-9936-79eec56e656d with scrape type 1
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_adecdaac65d90e1cf82279b59bc79d35.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-04-27 07:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c with scrape type 1
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_65794b4c64be404ed92f227ffcceb2a3.jpg not downloaded yet
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_81af4220e4ef7b9da3a2756cb409fa8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_ec81b98ea32bd92817e739748b2cefce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_0f7a352d5dbd87629cde4a84c28fd231.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b32587074306b959e9bec9265dc55562.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_51718e0a4b386c10bb49e8e32b5762dd.jpg not downloaded yet
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_ccf262cd4897ee3315a796fd6aba7a28.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_aace984ca984f5a6712e999e089b99aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_8c8d876d843f543281b526d6f3958c56.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_112a726d0220c8da85995d9dd901f512.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_df0b29288c02adf7be9f703fa3256bd1.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_53330577db0944b0544d634b43a796c6.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_90cddb0bc4f5c565ed125ffe4b387527.jpg not downloaded yet
2026-04-27 07:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_01f3fb81291f9753a42af29020b990ab.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_847b0d64e20cc30eaf8926704b8822c5.jpg not downloaded yet
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ92220> (referer: https://www.auto1.com/v1/car-details-view/UZ92220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d050>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_ecc2dbc04cd5b482a09c3d45a6c7adbe.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5ba0d7651fb5fe5a36df95f04b77fd6c.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_7bf3cabae27ca32354539f419924c332.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_a741fbc1b57286c1fa66b7646c8d203f.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_ebc6efe3efbb33023da7ebcee49b2e0a.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f619cc0bd52664a02322d3c202cc7d3a.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4f8b380b2fa459367aa5f722d16eaf65.jpg not downloaded yet
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaad50>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_81af4220e4ef7b9da3a2756cb409fa8b.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fbc410>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_ec81b98ea32bd92817e739748b2cefce.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa5510>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_0f7a352d5dbd87629cde4a84c28fd231.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_52489f4fed8359825f25171f4b5427e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_d57b47718cc045e7da8c57babdd94a57.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_31b24e31ee84713dba9cfa27c257b908.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_fc2c0bf213c4d82a0b711031cc2c6cde.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_904bb1838d07cac3f24cb933abe02a93.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_628ccf2737f78a4669b956af11c4c4ea.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_355e81d28f550573dee79d9d07dc2714.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_69c10f5407bd4a301cded83c6ee5420a.jpg not downloaded yet
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_9e3982759633677492349032396b7936.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a2656a1f97ebf23be48f34b2745a2ec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4d1f316e343d252c02bd3bf3f2d88c9a.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_79528c51d1780c5cddeb3ed1ece8b85a.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_e184b094714781901372f77bc2907553.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_d15bc5029e3d7255afc80fedeaa8a282.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_a4e90a01946d8c093f872208f020d480.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b0d6e9f00807ab57b5a5947af3b54893.jpg not downloaded yet
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffb3d0>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_ccf262cd4897ee3315a796fd6aba7a28.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d96b90>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_aace984ca984f5a6712e999e089b99aa.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7152f334-33f9-5a1c-85fd-68d886041486 with identifier: UZ92220
2026-04-27 07:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7152f334-33f9-5a1c-85fd-68d886041486 with scrape type 1
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ba89f66c8942a2e3521775693d08b060.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_e0e377f49374ef456ba7af5052813918.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_bdfd2268cf4b84f0c52b57c53576cff0.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_83740376072c638d27575fb68e56080e.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_9e8edd6d32a619c4fdc11931e9183db7.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_80734beb51b4825e8bf7d02afbed036b.jpg not downloaded yet
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_87a47ad09d816ee2994f3acd983176e3.jpg not downloaded yet
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_20a53322934ad335970861b6938734f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_adecdaac65d90e1cf82279b59bc79d35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_65794b4c64be404ed92f227ffcceb2a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_3865b86b0c2c6ce6ed49a8b67f845c03.jpg not downloaded yet
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e09d0>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_52489f4fed8359825f25171f4b5427e2.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d68e10>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_d57b47718cc045e7da8c57babdd94a57.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da3d90>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_31b24e31ee84713dba9cfa27c257b908.jpg saved to cache
2026-04-27 07:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8e090>
2026-04-27 07:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_9e3982759633677492349032396b7936.jpg saved to cache
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6450>
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a2656a1f97ebf23be48f34b2745a2ec3.jpg saved to cache
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_6384345fbbd5bbb429c0a444c32cf779.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_0999feb782666db40a5a174d42c993d9.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e424f8a7a30078c07af3d10ca29e8704.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b90c8d354442ab880669d021f4d58a70.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_507bd331c7691905b95245c88a92286c.jpg not downloaded yet
2026-04-27 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c77c78d6272e0cbc5955a4ebf7551c85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_847b0d64e20cc30eaf8926704b8822c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a62c108513172ccda9759c759b23047c.jpg not downloaded yet
2026-04-27 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f619cc0bd52664a02322d3c202cc7d3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_659cb2c72769ae3b23dffe1add0c5d58.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_abeb989239daa9f46fd8fb718f51679f.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e5ce3134002114383109254f88557473.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_2d69767f683d9ca861bddd05edc80083.jpg not downloaded yet
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9899892307beb29b9c142859d788848c.jpg not downloaded yet
2026-04-27 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP22273> (referer: https://www.auto1.com/v1/car-details-view/YP22273/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM11398> (referer: https://www.auto1.com/v1/car-details-view/GM11398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40bd0>
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_20a53322934ad335970861b6938734f9.jpg saved to cache
2026-04-27 07:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e90c90>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_adecdaac65d90e1cf82279b59bc79d35.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6ad0>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_65794b4c64be404ed92f227ffcceb2a3.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_c29ac2039897f44d08fe5674f6f4371c.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_69c10f5407bd4a301cded83c6ee5420a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_355e81d28f550573dee79d9d07dc2714.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_e0e377f49374ef456ba7af5052813918.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_a741fbc1b57286c1fa66b7646c8d203f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_89ba30371206cf395f26e8bab5ec7aca.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_f95e2c35301bc2b66e79c69cbfd1c72c.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_1fa60da6a1a3fee4b322d292298a0081.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_656979f145920dcfd0f1b183b9964ff2.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ee8f21eef28eb46f49e21fe85f6920c2.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_ebc6efe3efbb33023da7ebcee49b2e0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_9e5d49514fe3a6dd78446e002064e60b.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_3811d008260d87a497743c7f7afdbc57.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_31c0a9d3976c7f3c61a2486d1d258de9.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f1f789d4d4d8fc6911b7b3598c058f6a.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_700acde5c4aa61f0ba6216aaf573a710.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ba89f66c8942a2e3521775693d08b060.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe8350>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c77c78d6272e0cbc5955a4ebf7551c85.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e60890>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_847b0d64e20cc30eaf8926704b8822c5.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d914d0>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f619cc0bd52664a02322d3c202cc7d3a.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bea4933-3e23-5594-83e9-7084c007debd with identifier: YP22273
2026-04-27 07:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bea4933-3e23-5594-83e9-7084c007debd with scrape type 1
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_70ef031d7c9b19713256691acfe7dcee.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 864620af-132b-5faf-bbac-e00ec2b86ef0 with identifier: GM11398
2026-04-27 07:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864620af-132b-5faf-bbac-e00ec2b86ef0 with scrape type 1
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_f5aab30be2ea4c72e51c27baf3bd4739.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_507bd331c7691905b95245c88a92286c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9f3d8a6966677dd07bb55ed69e554be8.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9899892307beb29b9c142859d788848c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7f16f511bce5d2affd68b3671d34b404.jpg not downloaded yet
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_dffa8331a91265645cb86703bfe69a4a.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b0d6e9f00807ab57b5a5947af3b54893.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_3865b86b0c2c6ce6ed49a8b67f845c03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_87a47ad09d816ee2994f3acd983176e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_d764ba4577b28f6559664e3ab5721508.jpg not downloaded yet
2026-04-27 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA37789> (referer: https://www.auto1.com/v1/car-details-view/KA37789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d93550>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_69c10f5407bd4a301cded83c6ee5420a.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c13290>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_355e81d28f550573dee79d9d07dc2714.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df1e90>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_e0e377f49374ef456ba7af5052813918.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c098d0>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_a741fbc1b57286c1fa66b7646c8d203f.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df2fd0>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_ebc6efe3efbb33023da7ebcee49b2e0a.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30079fd0>
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ba89f66c8942a2e3521775693d08b060.jpg saved to cache
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_05e4a71b018f0169390428d9e0cfcda4.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_31e5520aff0b560af0f061d7f7f221a1.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_0a5a4f4d1ded7db98350588c74bfbb0b.jpg not downloaded yet
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_2d69767f683d9ca861bddd05edc80083.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e5ce3134002114383109254f88557473.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_d8e609d0e8969c0bf7965a1ca63ba341.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_bde2b77bae5e869c9702a9770ba960a7.jpg not downloaded yet
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c189d0>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_507bd331c7691905b95245c88a92286c.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5510>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9899892307beb29b9c142859d788848c.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e84850>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b0d6e9f00807ab57b5a5947af3b54893.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301661d0>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_3865b86b0c2c6ce6ed49a8b67f845c03.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077dd0>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_87a47ad09d816ee2994f3acd983176e3.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac4376b-a583-50e0-8569-13161203e1e1 with identifier: KA37789
2026-04-27 07:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac4376b-a583-50e0-8569-13161203e1e1 with scrape type 1
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_d1b84b813cac400528dcabb8e5fc5a7d.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_a23917f6e623203b100441bb2d9a4f5f.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_9691970d2edebe7247943c0db85990aa.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_8705cf5a21370eab7ab0ced59a2041cb.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d6e4d1645460fc8e244a4a0dd47b24f.jpg not downloaded yet
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_abeb989239daa9f46fd8fb718f51679f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a62c108513172ccda9759c759b23047c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_659cb2c72769ae3b23dffe1add0c5d58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_c29ac2039897f44d08fe5674f6f4371c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c92baf3877b8fb4612cf0e651eb17b55.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_c5bda70589f288d88a4215fc1d4db601.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_71a5438cab235627ba6473376b84f9e5.jpg not downloaded yet
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ee8f21eef28eb46f49e21fe85f6920c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_700acde5c4aa61f0ba6216aaf573a710.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65b10>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_2d69767f683d9ca861bddd05edc80083.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f7b9d0>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e5ce3134002114383109254f88557473.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_345350a34cc5e15e698d2bd3d9f8d5b7.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_7ec2820b6d55d7c58a36c4cc9ad1ed1e.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_0e1c57555aa3955f22f090631dc147f2.jpg not downloaded yet
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f1f789d4d4d8fc6911b7b3598c058f6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_70ef031d7c9b19713256691acfe7dcee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_f5aab30be2ea4c72e51c27baf3bd4739.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7757651cb65b174564e3b4880df5b85e.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_b5d7635d00e61a4efa3175619230663c.jpg not downloaded yet
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d800c8d8f8198d86ce96786d7ec3ade.jpg not downloaded yet
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce5090>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_abeb989239daa9f46fd8fb718f51679f.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffa910>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a62c108513172ccda9759c759b23047c.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30041450>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_659cb2c72769ae3b23dffe1add0c5d58.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffb510>
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_c29ac2039897f44d08fe5674f6f4371c.jpg saved to cache
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9f3d8a6966677dd07bb55ed69e554be8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_26a1164e53de7c59451a8ac39523a399.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_95d2db38b1d7e2d3059a5b1251b39d34.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_000556f62c1029780816e218ce4fcade.jpg not downloaded yet
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6f0d0>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ee8f21eef28eb46f49e21fe85f6920c2.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300592d0>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_700acde5c4aa61f0ba6216aaf573a710.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_31e5520aff0b560af0f061d7f7f221a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_dffa8331a91265645cb86703bfe69a4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c0dda28d0a0a8f37e334d3581fb66c29.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_d0ba3b8aa1c1ef46c6bcc9c5b611088d.jpg not downloaded yet
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_f303c9fa643dbd55a4aa6201d0f130c7.jpg not downloaded yet
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c2550>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f1f789d4d4d8fc6911b7b3598c058f6a.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5790>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_70ef031d7c9b19713256691acfe7dcee.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffb290>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_f5aab30be2ea4c72e51c27baf3bd4739.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2cc4c3fa8839578d011fd4db922ab16a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_a23917f6e623203b100441bb2d9a4f5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_d1b84b813cac400528dcabb8e5fc5a7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d6f10>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9f3d8a6966677dd07bb55ed69e554be8.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_d8e609d0e8969c0bf7965a1ca63ba341.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_9a660b40dff630931e0dce379614731e.jpg not downloaded yet
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030bb10>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_31e5520aff0b560af0f061d7f7f221a1.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d839d0>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_dffa8331a91265645cb86703bfe69a4a.jpg saved to cache
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d6e4d1645460fc8e244a4a0dd47b24f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_c82c8f4a0f34e1d8058e21b9e5304fd3.jpg not downloaded yet
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_7ec2820b6d55d7c58a36c4cc9ad1ed1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_0e1c57555aa3955f22f090631dc147f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_a2fa8a6fa655d67d716b710d3269f232.jpg not downloaded yet
2026-04-27 07:54:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006dfd0>
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2cc4c3fa8839578d011fd4db922ab16a.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1d9d0>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_a23917f6e623203b100441bb2d9a4f5f.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da0f50>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_d1b84b813cac400528dcabb8e5fc5a7d.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30048950>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_d8e609d0e8969c0bf7965a1ca63ba341.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_345350a34cc5e15e698d2bd3d9f8d5b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_b5d7635d00e61a4efa3175619230663c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d800c8d8f8198d86ce96786d7ec3ade.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049e50>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d6e4d1645460fc8e244a4a0dd47b24f.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff34d0>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_7ec2820b6d55d7c58a36c4cc9ad1ed1e.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15f50>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_0e1c57555aa3955f22f090631dc147f2.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_26a1164e53de7c59451a8ac39523a399.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7757651cb65b174564e3b4880df5b85e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_000556f62c1029780816e218ce4fcade.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_95d2db38b1d7e2d3059a5b1251b39d34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fbc890>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_345350a34cc5e15e698d2bd3d9f8d5b7.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa4e10>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_b5d7635d00e61a4efa3175619230663c.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f51090>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d800c8d8f8198d86ce96786d7ec3ade.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9ebd0>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_26a1164e53de7c59451a8ac39523a399.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da2d50>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7757651cb65b174564e3b4880df5b85e.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e63290>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_000556f62c1029780816e218ce4fcade.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2bbd0>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_95d2db38b1d7e2d3059a5b1251b39d34.jpg saved to cache
2026-04-27 07:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_f303c9fa643dbd55a4aa6201d0f130c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_d0ba3b8aa1c1ef46c6bcc9c5b611088d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_9a660b40dff630931e0dce379614731e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5a732bdd9b4edae66c1de4b1294c6831.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_05e4a71b018f0169390428d9e0cfcda4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_bde2b77bae5e869c9702a9770ba960a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_8705cf5a21370eab7ab0ced59a2041cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_c82c8f4a0f34e1d8058e21b9e5304fd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_d764ba4577b28f6559664e3ab5721508.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32098b90>
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_f303c9fa643dbd55a4aa6201d0f130c7.jpg saved to cache
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_71a5438cab235627ba6473376b84f9e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_0a5a4f4d1ded7db98350588c74bfbb0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7e5910>
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_d0ba3b8aa1c1ef46c6bcc9c5b611088d.jpg saved to cache
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fd6cd0>
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_9a660b40dff630931e0dce379614731e.jpg saved to cache
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c28350>
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5a732bdd9b4edae66c1de4b1294c6831.jpg saved to cache
2026-04-27 07:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c209d0>
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_05e4a71b018f0169390428d9e0cfcda4.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7e010>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_bde2b77bae5e869c9702a9770ba960a7.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd4950>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_8705cf5a21370eab7ab0ced59a2041cb.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc3410>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_c82c8f4a0f34e1d8058e21b9e5304fd3.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_a2fa8a6fa655d67d716b710d3269f232.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c0dda28d0a0a8f37e334d3581fb66c29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7f16f511bce5d2affd68b3671d34b404.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e145d0>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_d764ba4577b28f6559664e3ab5721508.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302a8ed0>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_71a5438cab235627ba6473376b84f9e5.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30292e90>
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_0a5a4f4d1ded7db98350588c74bfbb0b.jpg saved to cache
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7152f334-33f9-5a1c-85fd-68d886041486
2026-04-27 07:54:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7152f334-33f9-5a1c-85fd-68d886041486, skipping ID generation
2026-04-27 07:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7152f334-33f9-5a1c-85fd-68d886041486 with scrape type 1
2026-04-27 07:54:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7152f334-33f9-5a1c-85fd-68d886041486 sending to next pipeline
2026-04-27 07:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7152f334-33f9-5a1c-85fd-68d886041486, identifier: UZ92220
2026-04-27 07:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7152f334-33f9-5a1c-85fd-68d886041486 with identifier: UZ92220
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-04-27 07:54:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-04-27 07:54:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7152f334-33f9-5a1c-85fd-68d886041486 with identifier: UZ92220
2026-04-27 07:54:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7152f334-33f9-5a1c-85fd-68d886041486 with identifier: UZ92220 to the API
2026-04-27 07:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_0a5a4f4d1ded7db98350588c74bfbb0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Hattingen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:14:01Z',
 'fuel_type': 'petrol',
 'id': '7152f334-33f9-5a1c-85fd-68d886041486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ92220',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 122601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ba89f66c8942a2e3521775693d08b060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_87a47ad09d816ee2994f3acd983176e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_507bd331c7691905b95245c88a92286c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9899892307beb29b9c142859d788848c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_ee8f21eef28eb46f49e21fe85f6920c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_700acde5c4aa61f0ba6216aaf573a710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_9f3d8a6966677dd07bb55ed69e554be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_d764ba4577b28f6559664e3ab5721508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_0a5a4f4d1ded7db98350588c74bfbb0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7152f334-33f9-5a1c-85fd-68d886041486/7152f334-33f9-5a1c-85fd-68d886041486_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/aa/08aa4802407edad23e9429521ce0312b/pa/UZ92220_a23917f6e623203b100441bb2d9a4f5f.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2015-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-04-27 07:54:10 [auto1.de] INFO: Saving data for UZ92220: {'created_time': 1777276450.717777, 'last_price_update_time': 1777276450.717794, 'has_photos': True, 'auction_closing_time': 1777389241.0}
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c92baf3877b8fb4612cf0e651eb17b55.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_1fa60da6a1a3fee4b322d292298a0081.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_31c0a9d3976c7f3c61a2486d1d258de9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_3811d008260d87a497743c7f7afdbc57.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d78fd0>
2026-04-27 07:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_a2fa8a6fa655d67d716b710d3269f232.jpg saved to cache
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ac4376b-a583-50e0-8569-13161203e1e1
2026-04-27 07:54:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ac4376b-a583-50e0-8569-13161203e1e1, skipping ID generation
2026-04-27 07:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac4376b-a583-50e0-8569-13161203e1e1 with scrape type 1
2026-04-27 07:54:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ac4376b-a583-50e0-8569-13161203e1e1 sending to next pipeline
2026-04-27 07:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac4376b-a583-50e0-8569-13161203e1e1, identifier: KA37789
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fd66d0>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c0dda28d0a0a8f37e334d3581fb66c29.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa7550>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7f16f511bce5d2affd68b3671d34b404.jpg saved to cache
2026-04-27 07:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_9e5d49514fe3a6dd78446e002064e60b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_656979f145920dcfd0f1b183b9964ff2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac4376b-a583-50e0-8569-13161203e1e1 with identifier: KA37789
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-04-27 07:54:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac4376b-a583-50e0-8569-13161203e1e1 with identifier: KA37789
2026-04-27 07:54:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac4376b-a583-50e0-8569-13161203e1e1 with identifier: KA37789 to the API
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_a2fa8a6fa655d67d716b710d3269f232.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:38:01Z',
 'fuel_type': 'petrol',
 'id': '6ac4376b-a583-50e0-8569-13161203e1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA37789',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 18923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_d1b84b813cac400528dcabb8e5fc5a7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d6e4d1645460fc8e244a4a0dd47b24f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_71a5438cab235627ba6473376b84f9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_0e1c57555aa3955f22f090631dc147f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_6d800c8d8f8198d86ce96786d7ec3ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_000556f62c1029780816e218ce4fcade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_f303c9fa643dbd55a4aa6201d0f130c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_9a660b40dff630931e0dce379614731e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_c82c8f4a0f34e1d8058e21b9e5304fd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ac4376b-a583-50e0-8569-13161203e1e1/6ac4376b-a583-50e0-8569-13161203e1e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/cb/a1cba440d59458fd0889e14d998e6176/pa/KA37789_a2fa8a6fa655d67d716b710d3269f232.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2024-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-04-27 07:54:11 [auto1.de] INFO: Saving data for KA37789: {'created_time': 1777276451.871812, 'last_price_update_time': 1777276451.871829, 'has_photos': True, 'auction_closing_time': 1777390681.0}
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e424f8a7a30078c07af3d10ca29e8704.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b90c8d354442ab880669d021f4d58a70.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_89ba30371206cf395f26e8bab5ec7aca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_f95e2c35301bc2b66e79c69cbfd1c72c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa4050>
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c92baf3877b8fb4612cf0e651eb17b55.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014c090>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_1fa60da6a1a3fee4b322d292298a0081.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a0750>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_31c0a9d3976c7f3c61a2486d1d258de9.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd0290>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_3811d008260d87a497743c7f7afdbc57.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a3450>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_9e5d49514fe3a6dd78446e002064e60b.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c19cd0>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_656979f145920dcfd0f1b183b9964ff2.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_6384345fbbd5bbb429c0a444c32cf779.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_80734beb51b4825e8bf7d02afbed036b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_0999feb782666db40a5a174d42c993d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9cc90>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e424f8a7a30078c07af3d10ca29e8704.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017cfd0>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b90c8d354442ab880669d021f4d58a70.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30076250>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_89ba30371206cf395f26e8bab5ec7aca.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302893d0>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_f95e2c35301bc2b66e79c69cbfd1c72c.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_9e8edd6d32a619c4fdc11931e9183db7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_a4e90a01946d8c093f872208f020d480.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_c5bda70589f288d88a4215fc1d4db601.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_83740376072c638d27575fb68e56080e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_e184b094714781901372f77bc2907553.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e63250>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_6384345fbbd5bbb429c0a444c32cf779.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30284ad0>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_80734beb51b4825e8bf7d02afbed036b.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c03850>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_0999feb782666db40a5a174d42c993d9.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_d15bc5029e3d7255afc80fedeaa8a282.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4d1f316e343d252c02bd3bf3f2d88c9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c18e10>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_9e8edd6d32a619c4fdc11931e9183db7.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f4250>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_a4e90a01946d8c093f872208f020d480.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c23890>
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_c5bda70589f288d88a4215fc1d4db601.jpg saved to cache
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 864620af-132b-5faf-bbac-e00ec2b86ef0
2026-04-27 07:54:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 864620af-132b-5faf-bbac-e00ec2b86ef0, skipping ID generation
2026-04-27 07:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864620af-132b-5faf-bbac-e00ec2b86ef0 with scrape type 1
2026-04-27 07:54:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 864620af-132b-5faf-bbac-e00ec2b86ef0 sending to next pipeline
2026-04-27 07:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 864620af-132b-5faf-bbac-e00ec2b86ef0, identifier: GM11398
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014fe10>
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_83740376072c638d27575fb68e56080e.jpg saved to cache
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30293f50>
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_e184b094714781901372f77bc2907553.jpg saved to cache
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 864620af-132b-5faf-bbac-e00ec2b86ef0 with identifier: GM11398
2026-04-27 07:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 864620af-132b-5faf-bbac-e00ec2b86ef0 with identifier: GM11398
2026-04-27 07:54:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 864620af-132b-5faf-bbac-e00ec2b86ef0 with identifier: GM11398 to the API
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_c5bda70589f288d88a4215fc1d4db601.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Delmenhorst',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:17:10Z',
 'fuel_type': 'petrol',
 'id': '864620af-132b-5faf-bbac-e00ec2b86ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.0509,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM11398',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'location_confidence': 'geocoded',
 'longitude': 8.6291,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 101654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_f5aab30be2ea4c72e51c27baf3bd4739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_dffa8331a91265645cb86703bfe69a4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_31e5520aff0b560af0f061d7f7f221a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_bde2b77bae5e869c9702a9770ba960a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2783226,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_8705cf5a21370eab7ab0ced59a2041cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_c5bda70589f288d88a4215fc1d4db601.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_7ec2820b6d55d7c58a36c4cc9ad1ed1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_b5d7635d00e61a4efa3175619230663c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_95d2db38b1d7e2d3059a5b1251b39d34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_864620af-132b-5faf-bbac-e00ec2b86ef0/864620af-132b-5faf-bbac-e00ec2b86ef0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/81/3381d8c590241d4168287ed9d4b4f1bf/pa/GM11398_d0ba3b8aa1c1ef46c6bcc9c5b611088d.jpg',
             'Width': 800}],
 'postal_code': '27749',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2015-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-04-27 07:54:13 [auto1.de] INFO: Saving data for GM11398: {'created_time': 1777276453.857046, 'last_price_update_time': 1777276453.857071, 'has_photos': True, 'auction_closing_time': 1777389430.0}
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_904bb1838d07cac3f24cb933abe02a93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_628ccf2737f78a4669b956af11c4c4ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_9691970d2edebe7247943c0db85990aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_79528c51d1780c5cddeb3ed1ece8b85a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4f8b380b2fa459367aa5f722d16eaf65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_fc2c0bf213c4d82a0b711031cc2c6cde.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_7bf3cabae27ca32354539f419924c332.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ecd9310>
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_d15bc5029e3d7255afc80fedeaa8a282.jpg saved to cache
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdae50>
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4d1f316e343d252c02bd3bf3f2d88c9a.jpg saved to cache
2026-04-27 07:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_bdfd2268cf4b84f0c52b57c53576cff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e63f50>
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_904bb1838d07cac3f24cb933abe02a93.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_90cddb0bc4f5c565ed125ffe4b387527.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_53330577db0944b0544d634b43a796c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f37e10>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_628ccf2737f78a4669b956af11c4c4ea.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e87b50>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_9691970d2edebe7247943c0db85990aa.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bea4933-3e23-5594-83e9-7084c007debd
2026-04-27 07:54:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bea4933-3e23-5594-83e9-7084c007debd, skipping ID generation
2026-04-27 07:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bea4933-3e23-5594-83e9-7084c007debd with scrape type 1
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bea4933-3e23-5594-83e9-7084c007debd sending to next pipeline
2026-04-27 07:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bea4933-3e23-5594-83e9-7084c007debd, identifier: YP22273
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051fd0>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_79528c51d1780c5cddeb3ed1ece8b85a.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077290>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4f8b380b2fa459367aa5f722d16eaf65.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e87490>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_fc2c0bf213c4d82a0b711031cc2c6cde.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e1f710>
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_7bf3cabae27ca32354539f419924c332.jpg saved to cache
2026-04-27 07:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5ba0d7651fb5fe5a36df95f04b77fd6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_01f3fb81291f9753a42af29020b990ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_df0b29288c02adf7be9f703fa3256bd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_8c8d876d843f543281b526d6f3958c56.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_112a726d0220c8da85995d9dd901f512.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_51718e0a4b386c10bb49e8e32b5762dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bea4933-3e23-5594-83e9-7084c007debd with identifier: YP22273
2026-04-27 07:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bea4933-3e23-5594-83e9-7084c007debd with identifier: YP22273
2026-04-27 07:54:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bea4933-3e23-5594-83e9-7084c007debd with identifier: YP22273 to the API
2026-04-27 07:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_9691970d2edebe7247943c0db85990aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Sonneberg',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:41:29Z',
 'fuel_type': 'petrol',
 'id': '3bea4933-3e23-5594-83e9-7084c007debd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.3592,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP22273',
 'listing': 'auction',
 'location': 'DE, Sonneberg',
 'location_confidence': 'geocoded',
 'longitude': 11.1746,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 37562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_70ef031d7c9b19713256691acfe7dcee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7f16f511bce5d2affd68b3671d34b404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2283430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_05e4a71b018f0169390428d9e0cfcda4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_d8e609d0e8969c0bf7965a1ca63ba341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2221016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_9691970d2edebe7247943c0db85990aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2104163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c92baf3877b8fb4612cf0e651eb17b55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_345350a34cc5e15e698d2bd3d9f8d5b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_7757651cb65b174564e3b4880df5b85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_26a1164e53de7c59451a8ac39523a399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3bea4933-3e23-5594-83e9-7084c007debd/3bea4933-3e23-5594-83e9-7084c007debd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/50/ab50813377977cb29048b9c4ffea687f/pa/YP22273_c0dda28d0a0a8f37e334d3581fb66c29.jpg',
             'Width': 800}],
 'postal_code': '96515',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Thüringen',
 'region_code': 'DE-TH',
 'registration_date': '2019-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-04-27 07:54:15 [auto1.de] INFO: Saving data for YP22273: {'created_time': 1777276455.151139, 'last_price_update_time': 1777276455.151152, 'has_photos': True, 'auction_closing_time': 1777390889.0}
2026-04-27 07:54:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30197e90>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_bdfd2268cf4b84f0c52b57c53576cff0.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b32587074306b959e9bec9265dc55562.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_be60a3a203d8b9d222806d86e375225e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c19e10>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_90cddb0bc4f5c565ed125ffe4b387527.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a4d6143-d4e6-584b-b42f-08b6db2a674c, skipping ID generation
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c with scrape type 1
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c sending to next pipeline
2026-04-27 07:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a4d6143-d4e6-584b-b42f-08b6db2a674c, identifier: TF24039
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1e590>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_53330577db0944b0544d634b43a796c6.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7882a5d0-ec77-51f7-9936-79eec56e656d
2026-04-27 07:54:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7882a5d0-ec77-51f7-9936-79eec56e656d, skipping ID generation
2026-04-27 07:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7882a5d0-ec77-51f7-9936-79eec56e656d with scrape type 1
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7882a5d0-ec77-51f7-9936-79eec56e656d sending to next pipeline
2026-04-27 07:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7882a5d0-ec77-51f7-9936-79eec56e656d, identifier: TS14556
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c19fd0>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5ba0d7651fb5fe5a36df95f04b77fd6c.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffa550>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_01f3fb81291f9753a42af29020b990ab.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004a150>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_df0b29288c02adf7be9f703fa3256bd1.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0990>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_8c8d876d843f543281b526d6f3958c56.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005b010>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_112a726d0220c8da85995d9dd901f512.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e24750>
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_51718e0a4b386c10bb49e8e32b5762dd.jpg saved to cache
2026-04-27 07:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-04-27 07:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-04-27 07:54:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039 to the API
2026-04-27 07:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_90cddb0bc4f5c565ed125ffe4b387527.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:25:29Z',
 'fuel_type': 'petrol',
 'id': '1a4d6143-d4e6-584b-b42f-08b6db2a674c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF24039',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 51885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_65794b4c64be404ed92f227ffcceb2a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_90cddb0bc4f5c565ed125ffe4b387527.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f619cc0bd52664a02322d3c202cc7d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_69c10f5407bd4a301cded83c6ee5420a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b0d6e9f00807ab57b5a5947af3b54893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_80734beb51b4825e8bf7d02afbed036b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_b90c8d354442ab880669d021f4d58a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_2d69767f683d9ca861bddd05edc80083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_656979f145920dcfd0f1b183b9964ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a4d6143-d4e6-584b-b42f-08b6db2a674c/1a4d6143-d4e6-584b-b42f-08b6db2a674c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/5e/0d5e36cfd4f4e3c542b60082528c610c/pa/TF24039_f1f789d4d4d8fc6911b7b3598c058f6a.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2020}
2026-04-27 07:54:16 [auto1.de] INFO: Saving data for TF24039: {'created_time': 1777276456.211264, 'last_price_update_time': 1777276456.211278, 'has_photos': True, 'auction_closing_time': 1777389929.0}
2026-04-27 07:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7882a5d0-ec77-51f7-9936-79eec56e656d with identifier: TS14556
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-04-27 07:54:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7882a5d0-ec77-51f7-9936-79eec56e656d with identifier: TS14556
2026-04-27 07:54:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7882a5d0-ec77-51f7-9936-79eec56e656d with identifier: TS14556 to the API
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_53330577db0944b0544d634b43a796c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:22:35Z',
 'fuel_type': 'petrol',
 'id': '7882a5d0-ec77-51f7-9936-79eec56e656d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS14556',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 36364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_adecdaac65d90e1cf82279b59bc79d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_53330577db0944b0544d634b43a796c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_ebc6efe3efbb33023da7ebcee49b2e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_355e81d28f550573dee79d9d07dc2714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_a4e90a01946d8c093f872208f020d480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_9e8edd6d32a619c4fdc11931e9183db7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e424f8a7a30078c07af3d10ca29e8704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_e5ce3134002114383109254f88557473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_1fa60da6a1a3fee4b322d292298a0081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7882a5d0-ec77-51f7-9936-79eec56e656d/7882a5d0-ec77-51f7-9936-79eec56e656d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/56/ce56f4e46f37571adfcac5369f148189/pa/TS14556_31c0a9d3976c7f3c61a2486d1d258de9.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2021-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 45 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-04-27 07:54:18 [auto1.de] INFO: Saving data for TS14556: {'created_time': 1777276458.501286, 'last_price_update_time': 1777276458.501301, 'has_photos': True, 'auction_closing_time': 1777389755.0}
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_c43d9b933cb23eb51f5f50230240a7ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_1f44b2e2824a5e350e3a5d5220f1af53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_db482c2576fccb29bc92bb2e21cb7c3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301eb2d0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b32587074306b959e9bec9265dc55562.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0bad0>
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_be60a3a203d8b9d222806d86e375225e.jpg saved to cache
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8
2026-04-27 07:54:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8, skipping ID generation
2026-04-27 07:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with scrape type 1
2026-04-27 07:54:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 sending to next pipeline
2026-04-27 07:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8, identifier: KS87596
2026-04-27 07:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with identifier: KS87596
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-04-27 07:54:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with identifier: KS87596
2026-04-27 07:54:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ee61d8b-7776-5389-bbaa-cc728c15f3d8 with identifier: KS87596 to the API
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_be60a3a203d8b9d222806d86e375225e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Oberhausen',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-04-28T15:10:37Z',
 'fuel_type': 'petrol',
 'id': '0ee61d8b-7776-5389-bbaa-cc728c15f3d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.7833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS87596',
 'listing': 'auction',
 'location': 'DE, Oberhausen',
 'location_confidence': 'geocoded',
 'longitude': 11.1333,
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 46678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_be60a3a203d8b9d222806d86e375225e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_df0b29288c02adf7be9f703fa3256bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_a741fbc1b57286c1fa66b7646c8d203f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_628ccf2737f78a4669b956af11c4c4ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_d15bc5029e3d7255afc80fedeaa8a282.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_83740376072c638d27575fb68e56080e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_0999feb782666db40a5a174d42c993d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_abeb989239daa9f46fd8fb718f51679f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_f95e2c35301bc2b66e79c69cbfd1c72c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ee61d8b-7776-5389-bbaa-cc728c15f3d8/0ee61d8b-7776-5389-bbaa-cc728c15f3d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/cf/2acf23c426271c43701d1ec68c33ae89/pa/KS87596_3811d008260d87a497743c7f7afdbc57.jpg',
             'Width': 800}],
 'postal_code': '82386',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2017}
2026-04-27 07:54:19 [auto1.de] INFO: Saving data for KS87596: {'created_time': 1777276459.281726, 'last_price_update_time': 1777276459.281738, 'has_photos': True, 'auction_closing_time': 1777389037.0}
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_992674b999df4af19708590ec2740a02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_123131a22ec79432da45d0e2b164685d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_74699a6817a65ab7d5983bc1c76df4d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_ab33a0caf4df80fdf15225f09471aba2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_319508f8560433c2c6e5185d811c930c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_42efcf74f29bc4b3dfa23b709616a1eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_5ee36c8cdb5d3860014328963f0b1d82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df0790>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_c43d9b933cb23eb51f5f50230240a7ec.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d84690>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_1f44b2e2824a5e350e3a5d5220f1af53.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87
2026-04-27 07:54:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebb424d4-0ed7-5cfc-965f-05578a6c5c87, skipping ID generation
2026-04-27 07:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 1
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 sending to next pipeline
2026-04-27 07:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebb424d4-0ed7-5cfc-965f-05578a6c5c87, identifier: AM19734
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ce650>
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_db482c2576fccb29bc92bb2e21cb7c3b.jpg saved to cache
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfe1668b-4ef6-520e-a6fd-7fcece619760
2026-04-27 07:54:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfe1668b-4ef6-520e-a6fd-7fcece619760, skipping ID generation
2026-04-27 07:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe1668b-4ef6-520e-a6fd-7fcece619760 with scrape type 1
2026-04-27 07:54:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfe1668b-4ef6-520e-a6fd-7fcece619760 sending to next pipeline
2026-04-27 07:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfe1668b-4ef6-520e-a6fd-7fcece619760, identifier: JR08439
2026-04-27 07:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-04-27 07:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-04-27 07:54:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734 to the API
2026-04-27 07:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_1f44b2e2824a5e350e3a5d5220f1af53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Dortmund',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:48:30Z',
 'fuel_type': 'petrol',
 'id': 'ebb424d4-0ed7-5cfc-965f-05578a6c5c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM19734',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 92533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_1f44b2e2824a5e350e3a5d5220f1af53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a2656a1f97ebf23be48f34b2745a2ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_51718e0a4b386c10bb49e8e32b5762dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_847b0d64e20cc30eaf8926704b8822c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4f8b380b2fa459367aa5f722d16eaf65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_4d1f316e343d252c02bd3bf3f2d88c9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_e0e377f49374ef456ba7af5052813918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_3865b86b0c2c6ce6ed49a8b67f845c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_a62c108513172ccda9759c759b23047c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebb424d4-0ed7-5cfc-965f-05578a6c5c87/ebb424d4-0ed7-5cfc-965f-05578a6c5c87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/88/1188487132f5021d96c58b86001ea1d7/pa/AM19734_c29ac2039897f44d08fe5674f6f4371c.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 SIDI Turbo Excite',
 'transmission': 'manual',
 'trim': 'Excite',
 'year': 2018}
2026-04-27 07:54:20 [auto1.de] INFO: Saving data for AM19734: {'created_time': 1777276460.157285, 'last_price_update_time': 1777276460.157297, 'has_photos': True, 'auction_closing_time': 1777391310.0}
2026-04-27 07:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfe1668b-4ef6-520e-a6fd-7fcece619760 with identifier: JR08439
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-04-27 07:54:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfe1668b-4ef6-520e-a6fd-7fcece619760 with identifier: JR08439
2026-04-27 07:54:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfe1668b-4ef6-520e-a6fd-7fcece619760 with identifier: JR08439 to the API
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_db482c2576fccb29bc92bb2e21cb7c3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Hamburg',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:40:54Z',
 'fuel_type': 'diesel',
 'id': 'dfe1668b-4ef6-520e-a6fd-7fcece619760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.5544,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR08439',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'location_confidence': 'geocoded',
 'longitude': 9.9946,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 74883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_db482c2576fccb29bc92bb2e21cb7c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_112a726d0220c8da85995d9dd901f512.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_7bf3cabae27ca32354539f419924c332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_904bb1838d07cac3f24cb933abe02a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_e184b094714781901372f77bc2907553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2786259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_bdfd2268cf4b84f0c52b57c53576cff0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_6384345fbbd5bbb429c0a444c32cf779.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_659cb2c72769ae3b23dffe1add0c5d58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_89ba30371206cf395f26e8bab5ec7aca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dfe1668b-4ef6-520e-a6fd-7fcece619760/dfe1668b-4ef6-520e-a6fd-7fcece619760_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/48/a64857b88efe767293ccd37db2c1dbba/pa/JR08439_9e5d49514fe3a6dd78446e002064e60b.jpg',
             'Width': 800}],
 'postal_code': '20038',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Hamburg',
 'region_code': 'DE-HH',
 'registration_date': '2018-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 25d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-04-27 07:54:20 [auto1.de] INFO: Saving data for JR08439: {'created_time': 1777276460.770122, 'last_price_update_time': 1777276460.770135, 'has_photos': True, 'auction_closing_time': 1777390854.0}
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_cd9f85b15e595d699471d1d929712c63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3556f62478ebc3d8436439f2340648bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_a74014715b169c2312a97bcc5a61d2ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_9264d1670a5d9a7779570b51bdae0d78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b4e46a3e28b73d3f8ffe72f7f3335e23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bc050>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_992674b999df4af19708590ec2740a02.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df3bd0>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_123131a22ec79432da45d0e2b164685d.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee8b90>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_74699a6817a65ab7d5983bc1c76df4d3.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df3ad0>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_ab33a0caf4df80fdf15225f09471aba2.jpg saved to cache
2026-04-27 07:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6690>
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_319508f8560433c2c6e5185d811c930c.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1276fff7-28ab-5969-84ca-458048dc3292
2026-04-27 07:54:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1276fff7-28ab-5969-84ca-458048dc3292, skipping ID generation
2026-04-27 07:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1276fff7-28ab-5969-84ca-458048dc3292 with scrape type 1
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1276fff7-28ab-5969-84ca-458048dc3292 sending to next pipeline
2026-04-27 07:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1276fff7-28ab-5969-84ca-458048dc3292, identifier: BY28152
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165890>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_42efcf74f29bc4b3dfa23b709616a1eb.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30058bd0>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_5ee36c8cdb5d3860014328963f0b1d82.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1276fff7-28ab-5969-84ca-458048dc3292 with identifier: BY28152
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-04-27 07:54:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1276fff7-28ab-5969-84ca-458048dc3292 with identifier: BY28152
2026-04-27 07:54:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1276fff7-28ab-5969-84ca-458048dc3292 with identifier: BY28152 to the API
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_319508f8560433c2c6e5185d811c930c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Düren',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-04-28T15:28:07Z',
 'fuel_type': 'petrol',
 'id': '1276fff7-28ab-5969-84ca-458048dc3292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8009,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY28152',
 'listing': 'auction',
 'location': 'DE, Düren',
 'location_confidence': 'geocoded',
 'longitude': 6.4788,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 185684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_319508f8560433c2c6e5185d811c930c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_ecc2dbc04cd5b482a09c3d45a6c7adbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_aace984ca984f5a6712e999e089b99aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_20a53322934ad335970861b6938734f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1276fff7-28ab-5969-84ca-458048dc3292/1276fff7-28ab-5969-84ca-458048dc3292_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/9a/009a6a8de1033e06c360ce1878db93ab/pa/BY28152_31b24e31ee84713dba9cfa27c257b908.jpg',
             'Width': 800}],
 'postal_code': '52349',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2009-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-04-27 07:54:21 [auto1.de] INFO: Saving data for BY28152: {'created_time': 1777276461.768606, 'last_price_update_time': 1777276461.768618, 'has_photos': True, 'auction_closing_time': 1777390087.0}
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2804aeb22c42223abb24b04f2e26de33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_dc54c76bd5a8c02929578fc8738388b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_76dae5dd553078506aec633dcf5e7f0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_21d9aa24708d8fb7949b6e4da8579c5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_98d5ab0541ab0a48ab256e2fcf6c545d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f07690>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_cd9f85b15e595d699471d1d929712c63.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3e50>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3556f62478ebc3d8436439f2340648bb.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1d90>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_a74014715b169c2312a97bcc5a61d2ac.jpg saved to cache
2026-04-27 07:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed2c50>
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_9264d1670a5d9a7779570b51bdae0d78.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7e4310>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b4e46a3e28b73d3f8ffe72f7f3335e23.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3
2026-04-27 07:54:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c07b016d-ee6f-5a70-bba7-c1d167df6aa3, skipping ID generation
2026-04-27 07:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with scrape type 1
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3 sending to next pipeline
2026-04-27 07:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c07b016d-ee6f-5a70-bba7-c1d167df6aa3, identifier: NG94369
2026-04-27 07:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-04-27 07:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-04-27 07:54:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369 to the API
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b4e46a3e28b73d3f8ffe72f7f3335e23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-04-28T15:05:44Z',
 'fuel_type': 'diesel',
 'id': 'c07b016d-ee6f-5a70-bba7-c1d167df6aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG94369',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_0f7a352d5dbd87629cde4a84c28fd231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b4e46a3e28b73d3f8ffe72f7f3335e23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_5e36affe8d20a740b3cfb3b2b20068b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_992674b999df4af19708590ec2740a02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_123131a22ec79432da45d0e2b164685d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_81af4220e4ef7b9da3a2756cb409fa8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_c43d9b933cb23eb51f5f50230240a7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_52489f4fed8359825f25171f4b5427e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_b32587074306b959e9bec9265dc55562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c07b016d-ee6f-5a70-bba7-c1d167df6aa3/c07b016d-ee6f-5a70-bba7-c1d167df6aa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ac/e3acc16a3407120f5d70c76a8cab86d5/pa/NG94369_01f3fb81291f9753a42af29020b990ab.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-04-27 07:54:22 [auto1.de] INFO: Saving data for NG94369: {'created_time': 1777276462.74144, 'last_price_update_time': 1777276462.741455, 'has_photos': True, 'auction_closing_time': 1777388744.0}
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_4c19a48e44c298fd65ee990f6a602596.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3cd4f885de5402695e40d30df3ffea9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35810>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2804aeb22c42223abb24b04f2e26de33.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3850>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_dc54c76bd5a8c02929578fc8738388b3.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d303089d0>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_76dae5dd553078506aec633dcf5e7f0e.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b6410>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_21d9aa24708d8fb7949b6e4da8579c5b.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196a10>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_98d5ab0541ab0a48ab256e2fcf6c545d.jpg saved to cache
2026-04-27 07:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_2f3f80006b70392a4752d71e2f640425.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_aef8a6a41e59d681c5da9b10725f676c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c01c50>
2026-04-27 07:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_4c19a48e44c298fd65ee990f6a602596.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed1910>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3cd4f885de5402695e40d30df3ffea9e.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b2825b7-1499-538f-8225-9ebf52d58424
2026-04-27 07:54:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b2825b7-1499-538f-8225-9ebf52d58424, skipping ID generation
2026-04-27 07:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2825b7-1499-538f-8225-9ebf52d58424 with scrape type 1
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b2825b7-1499-538f-8225-9ebf52d58424 sending to next pipeline
2026-04-27 07:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b2825b7-1499-538f-8225-9ebf52d58424, identifier: PT33622
2026-04-27 07:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b2825b7-1499-538f-8225-9ebf52d58424 with identifier: PT33622
2026-04-27 07:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b2825b7-1499-538f-8225-9ebf52d58424 with identifier: PT33622
2026-04-27 07:54:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b2825b7-1499-538f-8225-9ebf52d58424 with identifier: PT33622 to the API
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3cd4f885de5402695e40d30df3ffea9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'city': 'Hanau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:01:36Z',
 'fuel_type': 'petrol',
 'id': '2b2825b7-1499-538f-8225-9ebf52d58424',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.1333,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT33622',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'location_confidence': 'geocoded',
 'longitude': 8.9167,
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 150990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3cd4f885de5402695e40d30df3ffea9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_ec81b98ea32bd92817e739748b2cefce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_9264d1670a5d9a7779570b51bdae0d78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_2b939ad1b8eae620a4dd9cdd86e07cdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2b2825b7-1499-538f-8225-9ebf52d58424/2b2825b7-1499-538f-8225-9ebf52d58424_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bdc72d41408d2b611a830c41e6be0d/pa/PT33622_3556f62478ebc3d8436439f2340648bb.jpg',
             'Width': 800}],
 'postal_code': '63405',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2006-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Edition',
 'transmission': 'manual',
 'trim': 'Compact Edition',
 'year': 2006}
2026-04-27 07:54:23 [auto1.de] INFO: Saving data for PT33622: {'created_time': 1777276463.650823, 'last_price_update_time': 1777276463.650836, 'has_photos': True, 'auction_closing_time': 1777388496.0}
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_f0ba1ba9fd2e2dd90dd84bf36e8679da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_fa00d958211fea7f844f34ae91cfddc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_b876321b4581493219b99bd3f67e7170.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_7473642febe23b79eadc0b63351d3d8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e30d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_2f3f80006b70392a4752d71e2f640425.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301df510>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_aef8a6a41e59d681c5da9b10725f676c.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc23d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_f0ba1ba9fd2e2dd90dd84bf36e8679da.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c30f10>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_fa00d958211fea7f844f34ae91cfddc3.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_804cc79c5f78a70dc1ac71ce77769f52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_b9008b02a58fada6f579d937a39f9570.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c130d0>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_b876321b4581493219b99bd3f67e7170.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed2d50>
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_7473642febe23b79eadc0b63351d3d8a.jpg saved to cache
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c
2026-04-27 07:54:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c, skipping ID generation
2026-04-27 07:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with scrape type 1
2026-04-27 07:54:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23e7c11-96a2-5efa-842b-d4fbc39d4d2c sending to next pipeline
2026-04-27 07:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c, identifier: BB97907
2026-04-27 07:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with identifier: BB97907
2026-04-27 07:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with identifier: BB97907
2026-04-27 07:54:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23e7c11-96a2-5efa-842b-d4fbc39d4d2c with identifier: BB97907 to the API
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_7473642febe23b79eadc0b63351d3d8a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'city': 'Bremen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.2L',
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:54:37Z',
 'fuel_type': 'petrol',
 'id': 'f23e7c11-96a2-5efa-842b-d4fbc39d4d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.0889,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB97907',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'location_confidence': 'geocoded',
 'longitude': 8.7906,
 'make': 'Chrysler',
 'model': 'Crossfire',
 'odometer': 83666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_b876321b4581493219b99bd3f67e7170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_7473642febe23b79eadc0b63351d3d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_2f3f80006b70392a4752d71e2f640425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_21d9aa24708d8fb7949b6e4da8579c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_76dae5dd553078506aec633dcf5e7f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_fb44b4c84fbc4c9b1c9fcfea41268609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_a74014715b169c2312a97bcc5a61d2ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_5ee36c8cdb5d3860014328963f0b1d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_74699a6817a65ab7d5983bc1c76df4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f23e7c11-96a2-5efa-842b-d4fbc39d4d2c/f23e7c11-96a2-5efa-842b-d4fbc39d4d2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/57/3657a50a18e3f5f48f6fa80b098fb01b/pa/BB97907_9e3982759633677492349032396b7936.jpg',
             'Width': 800}],
 'postal_code': '28195',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Bremen',
 'region_code': 'DE-HB',
 'registration_date': '2005-04-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Chrysler Crossfire 3.2 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2005}
2026-04-27 07:54:24 [auto1.de] INFO: Saving data for BB97907: {'created_time': 1777276464.477659, 'last_price_update_time': 1777276464.477671, 'has_photos': True, 'auction_closing_time': 1777391677.0}
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL21385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93990>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_804cc79c5f78a70dc1ac71ce77769f52.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a0a50>
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_b9008b02a58fada6f579d937a39f9570.jpg saved to cache
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 496549a9-9e52-58bf-87f1-c4f12a294fc1
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 496549a9-9e52-58bf-87f1-c4f12a294fc1, skipping ID generation
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496549a9-9e52-58bf-87f1-c4f12a294fc1 with scrape type 1
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 496549a9-9e52-58bf-87f1-c4f12a294fc1 sending to next pipeline
2026-04-27 07:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 496549a9-9e52-58bf-87f1-c4f12a294fc1, identifier: PH42253
2026-04-27 07:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 496549a9-9e52-58bf-87f1-c4f12a294fc1 with identifier: PH42253
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-04-27 07:54:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 496549a9-9e52-58bf-87f1-c4f12a294fc1 with identifier: PH42253
2026-04-27 07:54:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 496549a9-9e52-58bf-87f1-c4f12a294fc1 with identifier: PH42253 to the API
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_b9008b02a58fada6f579d937a39f9570.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'Ketzin',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:39:29Z',
 'fuel_type': 'diesel',
 'id': '496549a9-9e52-58bf-87f1-c4f12a294fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH42253',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 207204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_be620832a77a5303f9069b3adcd0bff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_56ee97313ac31bec6236625b6b92eb35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_6b5ee827f2a7b06b9f8092af4578b00f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_25074324e132854d9ad26f619e1d8ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_804cc79c5f78a70dc1ac71ce77769f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_b9008b02a58fada6f579d937a39f9570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_f0ba1ba9fd2e2dd90dd84bf36e8679da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_aef8a6a41e59d681c5da9b10725f676c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_98d5ab0541ab0a48ab256e2fcf6c545d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_496549a9-9e52-58bf-87f1-c4f12a294fc1/496549a9-9e52-58bf-87f1-c4f12a294fc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/13/0b139caf5d450508a92f51f91cebb5ea/pa/PH42253_dc54c76bd5a8c02929578fc8738388b3.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2013-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2013}
2026-04-27 07:54:25 [auto1.de] INFO: Saving data for PH42253: {'created_time': 1777276465.363364, 'last_price_update_time': 1777276465.363378, 'has_photos': True, 'auction_closing_time': 1777390769.0}
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_1d79fb124af7a098de0079b03ee0dd26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG72708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL26788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL59919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC68415> (referer: https://www.auto1.com/v1/car-details-view/CC68415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ18544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_3ad9383890ccd9bd7a29bd055ecc0d71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_0aa75cc7e1a61d4bae54afe06fa6f2f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c935a7c179765ee4b86a8abe03ed6b8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dd290>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_1d79fb124af7a098de0079b03ee0dd26.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:25 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 10550 | hits on page: 40
2026-04-27 07:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 259fc57b-96b6-5846-bd89-37bf5c203bb4 with identifier: CC68415
2026-04-27 07:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 259fc57b-96b6-5846-bd89-37bf5c203bb4 with scrape type 1
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_db59eafe8ce2d42e0bf23643d3505d99.jpg not downloaded yet
2026-04-27 07:54:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c30750>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_3ad9383890ccd9bd7a29bd055ecc0d71.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcff90>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_0aa75cc7e1a61d4bae54afe06fa6f2f8.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bddd8bba-032e-5929-a7aa-167b33634d74
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bddd8bba-032e-5929-a7aa-167b33634d74, skipping ID generation
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bddd8bba-032e-5929-a7aa-167b33634d74 with scrape type 1
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bddd8bba-032e-5929-a7aa-167b33634d74 sending to next pipeline
2026-04-27 07:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bddd8bba-032e-5929-a7aa-167b33634d74, identifier: SA28167
2026-04-27 07:54:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014c150>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c935a7c179765ee4b86a8abe03ed6b8c.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da9fdb83-a927-5486-91d4-5795d40c5744
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da9fdb83-a927-5486-91d4-5795d40c5744, skipping ID generation
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9fdb83-a927-5486-91d4-5795d40c5744 with scrape type 1
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da9fdb83-a927-5486-91d4-5795d40c5744 sending to next pipeline
2026-04-27 07:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da9fdb83-a927-5486-91d4-5795d40c5744, identifier: YF65310
2026-04-27 07:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bddd8bba-032e-5929-a7aa-167b33634d74 with identifier: SA28167
2026-04-27 07:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bddd8bba-032e-5929-a7aa-167b33634d74 with identifier: SA28167
2026-04-27 07:54:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bddd8bba-032e-5929-a7aa-167b33634d74 with identifier: SA28167 to the API
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_0aa75cc7e1a61d4bae54afe06fa6f2f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'city': 'Hof',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:25:40Z',
 'fuel_type': 'petrol',
 'id': 'bddd8bba-032e-5929-a7aa-167b33634d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.3209,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA28167',
 'listing': 'auction',
 'location': 'DE, Hof',
 'location_confidence': 'geocoded',
 'longitude': 11.9172,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 77715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_fa00d958211fea7f844f34ae91cfddc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_4c19a48e44c298fd65ee990f6a602596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2281038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_0aa75cc7e1a61d4bae54afe06fa6f2f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2804aeb22c42223abb24b04f2e26de33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_cd9f85b15e595d699471d1d929712c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_193eace04bd406455419815d8eef5e32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2243669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_1d79fb124af7a098de0079b03ee0dd26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_ab33a0caf4df80fdf15225f09471aba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_42efcf74f29bc4b3dfa23b709616a1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bddd8bba-032e-5929-a7aa-167b33634d74/bddd8bba-032e-5929-a7aa-167b33634d74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2257784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/7e/077e3e627e8068f50438e0268412af62/pa/SA28167_2cc4c3fa8839578d011fd4db922ab16a.jpg',
             'Width': 2048}],
 'postal_code': '95028',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Franconia',
 'province_code': 'DE-094',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2009-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-04-27 07:54:27 [auto1.de] INFO: Saving data for SA28167: {'created_time': 1777276467.358067, 'last_price_update_time': 1777276467.35808, 'has_photos': True, 'auction_closing_time': 1777389940.0}
2026-04-27 07:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da9fdb83-a927-5486-91d4-5795d40c5744 with identifier: YF65310
2026-04-27 07:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da9fdb83-a927-5486-91d4-5795d40c5744 with identifier: YF65310
2026-04-27 07:54:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da9fdb83-a927-5486-91d4-5795d40c5744 with identifier: YF65310 to the API
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c935a7c179765ee4b86a8abe03ed6b8c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Mainz-Kastel',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:10:03Z',
 'fuel_type': 'petrol',
 'id': 'da9fdb83-a927-5486-91d4-5795d40c5744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.0102,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF65310',
 'listing': 'auction',
 'location': 'DE, Mainz-Kastel (Wiesbaden)',
 'location_confidence': 'geocoded',
 'longitude': 8.2844,
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 142536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3981555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c935a7c179765ee4b86a8abe03ed6b8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3878929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5a732bdd9b4edae66c1de4b1294c6831.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_ccf262cd4897ee3315a796fd6aba7a28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_d57b47718cc045e7da8c57babdd94a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_c77c78d6272e0cbc5955a4ebf7551c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3378251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_3ad9383890ccd9bd7a29bd055ecc0d71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_8c8d876d843f543281b526d6f3958c56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_5ba0d7651fb5fe5a36df95f04b77fd6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_fc2c0bf213c4d82a0b711031cc2c6cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da9fdb83-a927-5486-91d4-5795d40c5744/da9fdb83-a927-5486-91d4-5795d40c5744_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/bf/f3bf4eb21f0607ff1e8cf44665c3dad1/pa/YF65310_79528c51d1780c5cddeb3ed1ece8b85a.jpg',
             'Width': 800}],
 'postal_code': '55252',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2010-08-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-04-27 07:54:27 [auto1.de] INFO: Saving data for YF65310: {'created_time': 1777276467.692379, 'last_price_update_time': 1777276467.692393, 'has_photos': True, 'auction_closing_time': 1777389003.0}
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: GM11398
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for GM11398: 0
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: UZ92220
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for UZ92220: 0
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: YP22273
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for YP22273: 0
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: VT80082
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for VT80082: 1
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_391318d68162c1e73d5528a57181f404.jpg not downloaded yet
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ68842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT65753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ83034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: PH76413
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for PH76413: 1
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_10b3bc56d180eebec6afac1fb2437bf2.jpg not downloaded yet
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM08023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: CH70761
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for CH70761: 1
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a59e0bb76efc57aad815ffe6d11ae3e.jpg not downloaded yet
2026-04-27 07:54:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:27 [auto1.de] INFO: Found listing with ID: WB86127
2026-04-27 07:54:27 [auto1.de] INFO: Scrape type for WB86127: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_e3420c5254c9501c28f756faa599ad56.jpg not downloaded yet
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: YF68308
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for YF68308: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_97d83f8d360767fa47e6723eb9c9c2fc.jpg not downloaded yet
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_db59eafe8ce2d42e0bf23643d3505d99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_391318d68162c1e73d5528a57181f404.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: CX32615
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for CX32615: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_ab70747f717be1ead0b5ff70f1ec1093.jpg not downloaded yet
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_10b3bc56d180eebec6afac1fb2437bf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: CC69895
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for CC69895: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a870e1616649c867b9f8a80b6ec6560.jpg not downloaded yet
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: RH00631
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for RH00631: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_9b862d31971c072e14427476240b4936.jpg not downloaded yet
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: GW94497
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for GW94497: 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_af4476363706311e2ac99ba68b40200c.jpg not downloaded yet
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea410>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_db59eafe8ce2d42e0bf23643d3505d99.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018b850>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_391318d68162c1e73d5528a57181f404.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: XZ49630
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for XZ49630: 1
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_ab70747f717be1ead0b5ff70f1ec1093.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [auto1.de] INFO: Found listing with ID: UA31834
2026-04-27 07:54:28 [auto1.de] INFO: Scrape type for UA31834: 2
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db170f97-3dd3-50ee-845b-81781d67d1d6 with identifier: UA31834
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db170f97-3dd3-50ee-845b-81781d67d1d6 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db170f97-3dd3-50ee-845b-81781d67d1d6 with scrape type 2
2026-04-27 07:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db170f97-3dd3-50ee-845b-81781d67d1d6, identifier: UA31834
2026-04-27 07:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db170f97-3dd3-50ee-845b-81781d67d1d6 with identifier: UA31834
2026-04-27 07:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db170f97-3dd3-50ee-845b-81781d67d1d6 with identifier: UA31834
2026-04-27 07:54:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db170f97-3dd3-50ee-845b-81781d67d1d6 with identifier: UA31834 to the API
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:16:36Z',
 'fuel_type': 'diesel',
 'id': 'db170f97-3dd3-50ee-845b-81781d67d1d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA31834',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 199353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2006-10-30',
 'seller_name': None,
 'title': 'Chrysler 300 C 3.0 CRD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-04-27 07:54:28 [auto1.de] INFO: Saving data for UA31834: {'auction_closing_time': 1777389396.0, 'created_time': 1777029723.079775, 'has_photos': True, 'last_price_update_time': 1777276468.960206}
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4af9ac90>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_10b3bc56d180eebec6afac1fb2437bf2.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: RV68126
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for RV68126: 1
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR59159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF30803> (referer: https://www.auto1.com/v1/car-details-view/CF30803/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV76032/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15890>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_ab70747f717be1ead0b5ff70f1ec1093.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: RT24797
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for RT24797: 1
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG92624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU19955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK84276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: FA09149
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for FA09149: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: RE47828
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for RE47828: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: CH71731
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for CH71731: 1
2026-04-27 07:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3100d070-8b2d-5237-8906-819b44a658d6 with identifier: CF30803
2026-04-27 07:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3100d070-8b2d-5237-8906-819b44a658d6 with scrape type 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_6f405916ffd4d0ece5a43bdfafea0c7f.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: JC11125
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for JC11125: 1
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_9b862d31971c072e14427476240b4936.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f55e2a1bd7812db1c268a037d4611e4.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: YK31247
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for YK31247: 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_e101af8f40e3c3f63ac2b23f595b9d23.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_af4476363706311e2ac99ba68b40200c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: XT69507
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for XT69507: 1
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a870e1616649c867b9f8a80b6ec6560.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_9f2c419272c94223c838331cc4010e0c.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: XX62478
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for XX62478: 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7bebe3e0c95d90ee736c842518bd4d20.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: FK16008
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for FK16008: 1
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c26fd0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_9b862d31971c072e14427476240b4936.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f0a9485d1de2aff66e8a0c1174b9108.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: FE20387
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for FE20387: 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_192d8ef960a77b3e946d248a33c7f50c.jpg not downloaded yet
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c264d0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_af4476363706311e2ac99ba68b40200c.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b950>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a870e1616649c867b9f8a80b6ec6560.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: XJ29416
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for XJ29416: 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_ac810edb335077b23bd6b6e7819b605f.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: CB78369
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for CB78369: 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7a7427cc444bd0b33532d323721f8a77.jpg not downloaded yet
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: JW55153
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for JW55153: 1
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE17862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_b35920e68b954d6d189cfbf0a9f0abd4.jpg not downloaded yet
2026-04-27 07:54:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: UM52003
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for UM52003: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: VR14791
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for VR14791: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: WS85819
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for WS85819: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: ET41038
2026-04-27 07:54:29 [auto1.de] INFO: Scrape type for ET41038: 1
2026-04-27 07:54:29 [auto1.de] INFO: Found listing with ID: AN27466
2026-04-27 07:54:30 [auto1.de] INFO: Scrape type for AN27466: 1
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7a7427cc444bd0b33532d323721f8a77.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA35415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT80082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL26788> (referer: https://www.auto1.com/v1/car-details-view/RL26788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM08023> (referer: https://www.auto1.com/v1/car-details-view/GM08023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ18544> (referer: https://www.auto1.com/v1/car-details-view/XJ18544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d7090>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7a7427cc444bd0b33532d323721f8a77.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be98ca77-db8a-53cd-891e-d3f1e8cced78 with identifier: RL26788
2026-04-27 07:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be98ca77-db8a-53cd-891e-d3f1e8cced78 with scrape type 1
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_edd8a7fe96327669eec3f1fd4d9a81e0.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5215c012-8fa8-5c05-b1c8-49bc2039d333 with identifier: GM08023
2026-04-27 07:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5215c012-8fa8-5c05-b1c8-49bc2039d333 with scrape type 1
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_733ca5cdd99ae82e29bad414bea0cd77.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f460ee-7459-5352-8c75-1e311af3bdd1 with identifier: XJ18544
2026-04-27 07:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f460ee-7459-5352-8c75-1e311af3bdd1 with scrape type 1
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_a6a8edcfe65035361e380f8038fc12ea.jpg not downloaded yet
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_b35920e68b954d6d189cfbf0a9f0abd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_4a3b688c77aba761f31b85eb9ffca84a.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_129e0eaddf6431405c701ab5a47e7efa.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_e06dfeba97a25b61412c240854fb7d1c.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_52b671695c3aaf90edd65a4f3e991d82.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_26946dcad6c87b3d50496b149989f89d.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_4b2d843a1ec30e371692627022401dc5.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_f59b06963988e5244bb11a02a9bae017.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_02f740b33a2284dcb2ef5f15cde21e5a.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_657fac55d7331c0cf169c213487436a5.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e11e8efaec82dbef722cba82cee42c70.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_7437b7f1c2eb0e2203b8b7828eb20499.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_b7fbc7014210d34f232021f91986f17f.jpg not downloaded yet
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b010>
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_b35920e68b954d6d189cfbf0a9f0abd4.jpg saved to cache
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e26c8293b0cd8ec6540df4e9cacb10a4.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_99a856f279fa1f9ed9a14c5c67c081a4.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_6e8b6b8e52142a26ee3a1698ad923bc3.jpg not downloaded yet
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_a6a8edcfe65035361e380f8038fc12ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_0f5ef534e8e721fe1f9bbc7ad567d675.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fc3c8849627180ce64d0407ee33d5fd4.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_f247339558aaca6dfa7bf45b4fd35249.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_5441361caf671f49b71061ba2132b85f.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_79ab203873ca1a1ea2c5f910e83df676.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_698d10be8487ab8ade12a8986d13f4f3.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_ea5fc707627ca6472eb2f565ee77dbbc.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fb2c2cd8542e563878b1475f02c995de.jpg not downloaded yet
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd2f90>
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_a6a8edcfe65035361e380f8038fc12ea.jpg saved to cache
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_6e8b6b8e52142a26ee3a1698ad923bc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW94497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH00631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301eba90>
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_6e8b6b8e52142a26ee3a1698ad923bc3.jpg saved to cache
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ83034> (referer: https://www.auto1.com/v1/car-details-view/CJ83034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ49630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_698d10be8487ab8ade12a8986d13f4f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_79ab203873ca1a1ea2c5f910e83df676.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fb2c2cd8542e563878b1475f02c995de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa09f01-3e8c-5a98-8e82-fe1f1beac239 with identifier: CJ83034
2026-04-27 07:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa09f01-3e8c-5a98-8e82-fe1f1beac239 with scrape type 1
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_9ed8aada2e5db2857dd435b292713bad.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_ef0e89b17095470dd8d3a07b6b05eb05.jpg not downloaded yet
2026-04-27 07:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_84ba89e5a791d52d1c21c6becc2ddf0d.jpg not downloaded yet
2026-04-27 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_ea5fc707627ca6472eb2f565ee77dbbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_8f291ddf780351ab4912f4613ff1017a.jpg not downloaded yet
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_f24a8ceeaac153869c9a0cd00e0a7b3b.jpg not downloaded yet
2026-04-27 07:54:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67690>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_698d10be8487ab8ade12a8986d13f4f3.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c35210>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_79ab203873ca1a1ea2c5f910e83df676.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7e7a10>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fb2c2cd8542e563878b1475f02c995de.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_481f641e2e93a07f98dd969117870129.jpg not downloaded yet
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_f247339558aaca6dfa7bf45b4fd35249.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_0fb352992b73f8c07884ea2db9448337.jpg not downloaded yet
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV68126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7e4950>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_ea5fc707627ca6472eb2f565ee77dbbc.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_c1d2faa11ef0ae4b22a0da2dfeb5c5d5.jpg not downloaded yet
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_e59c7da92cb40af6322ffd08c8d74f28.jpg not downloaded yet
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c46c10>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_f247339558aaca6dfa7bf45b4fd35249.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_2b0bd5b747e02f7e79ba65173459462d.jpg not downloaded yet
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_5441361caf671f49b71061ba2132b85f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_481f641e2e93a07f98dd969117870129.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_f24a8ceeaac153869c9a0cd00e0a7b3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_2b0bd5b747e02f7e79ba65173459462d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30141b50>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_5441361caf671f49b71061ba2132b85f.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_e59c7da92cb40af6322ffd08c8d74f28.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8f850>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_481f641e2e93a07f98dd969117870129.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e27090>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_f24a8ceeaac153869c9a0cd00e0a7b3b.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_c1d2faa11ef0ae4b22a0da2dfeb5c5d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT69507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d79cd0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_2b0bd5b747e02f7e79ba65173459462d.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_0fb352992b73f8c07884ea2db9448337.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e24250>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_e59c7da92cb40af6322ffd08c8d74f28.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_84ba89e5a791d52d1c21c6becc2ddf0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK31247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c02a50>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_c1d2faa11ef0ae4b22a0da2dfeb5c5d5.jpg saved to cache
2026-04-27 07:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44fd0>
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_0fb352992b73f8c07884ea2db9448337.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_9ed8aada2e5db2857dd435b292713bad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_8f291ddf780351ab4912f4613ff1017a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_ef0e89b17095470dd8d3a07b6b05eb05.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET41038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30060a10>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_84ba89e5a791d52d1c21c6becc2ddf0d.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fc3c8849627180ce64d0407ee33d5fd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30291550>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_9ed8aada2e5db2857dd435b292713bad.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09290>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_8f291ddf780351ab4912f4613ff1017a.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e26c8293b0cd8ec6540df4e9cacb10a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c11b50>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_ef0e89b17095470dd8d3a07b6b05eb05.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item caa09f01-3e8c-5a98-8e82-fe1f1beac239
2026-04-27 07:54:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caa09f01-3e8c-5a98-8e82-fe1f1beac239, skipping ID generation
2026-04-27 07:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa09f01-3e8c-5a98-8e82-fe1f1beac239 with scrape type 1
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caa09f01-3e8c-5a98-8e82-fe1f1beac239 sending to next pipeline
2026-04-27 07:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caa09f01-3e8c-5a98-8e82-fe1f1beac239, identifier: CJ83034
2026-04-27 07:54:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db7d10>
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fc3c8849627180ce64d0407ee33d5fd4.jpg saved to cache
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_0f5ef534e8e721fe1f9bbc7ad567d675.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caa09f01-3e8c-5a98-8e82-fe1f1beac239 with identifier: CJ83034
2026-04-27 07:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caa09f01-3e8c-5a98-8e82-fe1f1beac239 with identifier: CJ83034
2026-04-27 07:54:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caa09f01-3e8c-5a98-8e82-fe1f1beac239 with identifier: CJ83034 to the API
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_ef0e89b17095470dd8d3a07b6b05eb05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Hattingen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:26:17Z',
 'fuel_type': 'petrol',
 'id': 'caa09f01-3e8c-5a98-8e82-fe1f1beac239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ83034',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 45473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_9ed8aada2e5db2857dd435b292713bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_ef0e89b17095470dd8d3a07b6b05eb05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_84ba89e5a791d52d1c21c6becc2ddf0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_8f291ddf780351ab4912f4613ff1017a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_f24a8ceeaac153869c9a0cd00e0a7b3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_481f641e2e93a07f98dd969117870129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_0fb352992b73f8c07884ea2db9448337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_c1d2faa11ef0ae4b22a0da2dfeb5c5d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_e59c7da92cb40af6322ffd08c8d74f28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_caa09f01-3e8c-5a98-8e82-fe1f1beac239/caa09f01-3e8c-5a98-8e82-fe1f1beac239_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/3e/643ef646169a3cd69390cee2a16a1a12/pa/CJ83034_2b0bd5b747e02f7e79ba65173459462d.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prime 2WD',
 'transmission': 'automatic',
 'trim': 'Prime 2WD',
 'year': 2021}
2026-04-27 07:54:34 [auto1.de] INFO: Saving data for CJ83034: {'created_time': 1777276474.162241, 'last_price_update_time': 1777276474.162252, 'has_photos': True, 'auction_closing_time': 1777389977.0}
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_99a856f279fa1f9ed9a14c5c67c081a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS85819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE17862> (referer: https://www.auto1.com/v1/car-details-view/WE17862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL59919> (referer: https://www.auto1.com/v1/car-details-view/DL59919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db4710>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e26c8293b0cd8ec6540df4e9cacb10a4.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35350>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_0f5ef534e8e721fe1f9bbc7ad567d675.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_b7fbc7014210d34f232021f91986f17f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f36a50>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_99a856f279fa1f9ed9a14c5c67c081a4.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_02f740b33a2284dcb2ef5f15cde21e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_657fac55d7331c0cf169c213487436a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_f59b06963988e5244bb11a02a9bae017.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c96270c-f8aa-5a98-902f-e330046e715f with identifier: WE17862
2026-04-27 07:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c96270c-f8aa-5a98-902f-e330046e715f with scrape type 1
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_57ec73c879ed0cb5d972c0163fea58d0.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2648436b-04ff-5e54-a84b-cd12de005d49 with identifier: DL59919
2026-04-27 07:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2648436b-04ff-5e54-a84b-cd12de005d49 with scrape type 1
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_a4cda1e2a8baad84029c4899d7b81170.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_7437b7f1c2eb0e2203b8b7828eb20499.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e11e8efaec82dbef722cba82cee42c70.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_ee23a9219d2ba500edd153f5bf342288.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_e6441633085544da9cbb25548899b022.jpg not downloaded yet
2026-04-27 07:54:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300eb450>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_b7fbc7014210d34f232021f91986f17f.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_61cbe33edc77cd9f7e48e80c0160b8c5.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_9a43ef19392f5508f64ddd69e6947d1e.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM52003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_4a902569fd3f947d098ebfcaa67aed55.jpg not downloaded yet
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_dee822bb989a77b9b52a58b0f1ef5669.jpg not downloaded yet
2026-04-27 07:54:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_26946dcad6c87b3d50496b149989f89d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75cd0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_02f740b33a2284dcb2ef5f15cde21e5a.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6a090>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_657fac55d7331c0cf169c213487436a5.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea0850>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_f59b06963988e5244bb11a02a9bae017.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c29990>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_7437b7f1c2eb0e2203b8b7828eb20499.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d82110>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e11e8efaec82dbef722cba82cee42c70.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_12fe862887e39c0d6d08f86a8282a03d.jpg not downloaded yet
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_2c99c3d09bb77e8b0311359acdc96ce7.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_52b671695c3aaf90edd65a4f3e991d82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_129e0eaddf6431405c701ab5a47e7efa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_8d665a948a9ef505d9444d04098cac24.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH00631> (referer: https://www.auto1.com/v1/car-details-view/RH00631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30131e10>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_26946dcad6c87b3d50496b149989f89d.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR14791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_2047ce96c5acfac9f62843c04ae0f4c1.jpg not downloaded yet
2026-04-27 07:54:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_9a43ef19392f5508f64ddd69e6947d1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_328f402714efa79dafe5c8e36050a6f5.jpg not downloaded yet
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014f0d0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_52b671695c3aaf90edd65a4f3e991d82.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0c210>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_129e0eaddf6431405c701ab5a47e7efa.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_fcf43a0da53ecbac420204698f986128.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_61cbe33edc77cd9f7e48e80c0160b8c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_dee822bb989a77b9b52a58b0f1ef5669.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_6f6c96e21f01334fc46fc9da19112d09.jpg not downloaded yet
2026-04-27 07:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with identifier: RH00631
2026-04-27 07:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with scrape type 1
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c58a82b5e90a23133ed3f49b8bb41dad.jpg not downloaded yet
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0e0d0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_9a43ef19392f5508f64ddd69e6947d1e.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_2c99c3d09bb77e8b0311359acdc96ce7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_12fe862887e39c0d6d08f86a8282a03d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_0c8050359a54f6799b00b3522642e6a5.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_8d665a948a9ef505d9444d04098cac24.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c286de39109451ab84cbee7b502999cb.jpg not downloaded yet
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_4b9e27f6255eb34757c29fe8bd5674f1.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_fcf43a0da53ecbac420204698f986128.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c18110>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_61cbe33edc77cd9f7e48e80c0160b8c5.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004a710>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_dee822bb989a77b9b52a58b0f1ef5669.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_1ed6cf836cfd7cc993d791555fab47c7.jpg not downloaded yet
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_0c8050359a54f6799b00b3522642e6a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_ca719393baf41a17aa17ed679347654d.jpg not downloaded yet
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7af150>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_2c99c3d09bb77e8b0311359acdc96ce7.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c36590>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_12fe862887e39c0d6d08f86a8282a03d.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a0ad0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_8d665a948a9ef505d9444d04098cac24.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_328f402714efa79dafe5c8e36050a6f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c286de39109451ab84cbee7b502999cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_daae670efbf06b02d3c44ff174c6b9fe.jpg not downloaded yet
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff3c90>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_fcf43a0da53ecbac420204698f986128.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb2810>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_0c8050359a54f6799b00b3522642e6a5.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_f85546a4de63359e6171a0a81b026bab.jpg not downloaded yet
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_1ed6cf836cfd7cc993d791555fab47c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW94497> (referer: https://www.auto1.com/v1/car-details-view/GW94497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_954dbadf51204946f2a225666bce4ee7.jpg not downloaded yet
2026-04-27 07:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30095550>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_328f402714efa79dafe5c8e36050a6f5.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc9810>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c286de39109451ab84cbee7b502999cb.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_4b9e27f6255eb34757c29fe8bd5674f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c501daf0c0060161e06139ae73926b5c.jpg not downloaded yet
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9590>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_1ed6cf836cfd7cc993d791555fab47c7.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with identifier: GW94497
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ab4f19f44b198857bf3a390188aca3fa.jpg not downloaded yet
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_08f24f1804e00d8f00206f9c48f31901.jpg not downloaded yet
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_f85546a4de63359e6171a0a81b026bab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_4b2d843a1ec30e371692627022401dc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_8ab366eb4a2833d0c5b9157591e98e14.jpg not downloaded yet
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da3350>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_4b9e27f6255eb34757c29fe8bd5674f1.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_daae670efbf06b02d3c44ff174c6b9fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_e8426c6c27e3e5ba16f7a23149c00f4c.jpg not downloaded yet
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_954dbadf51204946f2a225666bce4ee7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ab4f19f44b198857bf3a390188aca3fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_076706fe7643e88f2dae6a1dde3fa248.jpg not downloaded yet
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV68126> (referer: https://www.auto1.com/v1/car-details-view/RV68126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT69507> (referer: https://www.auto1.com/v1/car-details-view/XT69507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ea317f8fb77ac86beaa7c58958020542.jpg not downloaded yet
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dca310>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_f85546a4de63359e6171a0a81b026bab.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_e06dfeba97a25b61412c240854fb7d1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_19f77611012fddc209343c850a1ca7b8.jpg not downloaded yet
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f53290>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_4b2d843a1ec30e371692627022401dc5.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c501daf0c0060161e06139ae73926b5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET41038> (referer: https://www.auto1.com/v1/car-details-view/ET41038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_82e86fe91940ecbeab31ef361ad37fd5.jpg not downloaded yet
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_08f24f1804e00d8f00206f9c48f31901.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_8ab366eb4a2833d0c5b9157591e98e14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_e8426c6c27e3e5ba16f7a23149c00f4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030a490>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_daae670efbf06b02d3c44ff174c6b9fe.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e61650>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_954dbadf51204946f2a225666bce4ee7.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15410>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ab4f19f44b198857bf3a390188aca3fa.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa48293-f5af-5f04-bd19-f48f7b1dbdfe with identifier: RV68126
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b54fcb9d3d577f1116e41bcffa971356.jpg not downloaded yet
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with identifier: XT69507
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5fee7a0497f226e43a972b4b9a844a8d.jpg not downloaded yet
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_1abeffe6af25aebfa37d5676e2664dbd.jpg not downloaded yet
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b09e816594452593928a577e0ecf280f.jpg not downloaded yet
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_2732b16845a847475d8ac3f82543606d.jpg not downloaded yet
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee52d0>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_e06dfeba97a25b61412c240854fb7d1c.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13f460ee-7459-5352-8c75-1e311af3bdd1
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13f460ee-7459-5352-8c75-1e311af3bdd1, skipping ID generation
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f460ee-7459-5352-8c75-1e311af3bdd1 with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13f460ee-7459-5352-8c75-1e311af3bdd1 sending to next pipeline
2026-04-27 07:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13f460ee-7459-5352-8c75-1e311af3bdd1, identifier: XJ18544
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_6f6c96e21f01334fc46fc9da19112d09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_076706fe7643e88f2dae6a1dde3fa248.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_d2c07cd0ad2886a5bd06a6ca74cf5487.jpg not downloaded yet
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13f460ee-7459-5352-8c75-1e311af3bdd1 with identifier: XJ18544
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13f460ee-7459-5352-8c75-1e311af3bdd1 with identifier: XJ18544
2026-04-27 07:54:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13f460ee-7459-5352-8c75-1e311af3bdd1 with identifier: XJ18544 to the API
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_e06dfeba97a25b61412c240854fb7d1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'city': 'Leipzig',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-04-28T15:33:24Z',
 'fuel_type': 'petrol',
 'id': '13f460ee-7459-5352-8c75-1e311af3bdd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3405,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ18544',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'location_confidence': 'geocoded',
 'longitude': 12.3827,
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 106629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_a6a8edcfe65035361e380f8038fc12ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851915,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_e06dfeba97a25b61412c240854fb7d1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_4b2d843a1ec30e371692627022401dc5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_657fac55d7331c0cf169c213487436a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_b7fbc7014210d34f232021f91986f17f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_6e8b6b8e52142a26ee3a1698ad923bc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fc3c8849627180ce64d0407ee33d5fd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_5441361caf671f49b71061ba2132b85f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_698d10be8487ab8ade12a8986d13f4f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13f460ee-7459-5352-8c75-1e311af3bdd1/13f460ee-7459-5352-8c75-1e311af3bdd1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/95/ec95447545034f8f4152733d3ca7ed9b/pa/XJ18544_fb2c2cd8542e563878b1475f02c995de.jpg',
             'Width': 800}],
 'postal_code': '04103',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen',
 'region_code': 'DE-SN',
 'registration_date': '2014-12-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 sDrive 35is',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-04-27 07:54:38 [auto1.de] INFO: Saving data for XJ18544: {'created_time': 1777276478.085513, 'last_price_update_time': 1777276478.085526, 'has_photos': True, 'auction_closing_time': 1777390404.0}
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb10893c7f2c98bd37df3dd134040470.jpg not downloaded yet
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_855273d899824e728684e1cf455f344d.jpg not downloaded yet
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd66d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c501daf0c0060161e06139ae73926b5c.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2a23a3-62ea-5891-927c-d6187bbed390 with identifier: ET41038
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2a23a3-62ea-5891-927c-d6187bbed390 with scrape type 1
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 6b2a23a3-62ea-5891-927c-d6187bbed390
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_3ecb62f1c05b4620ba853d5e0ec6578d.jpg not downloaded yet
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6e190>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_08f24f1804e00d8f00206f9c48f31901.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6c950>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_8ab366eb4a2833d0c5b9157591e98e14.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb0450>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_e8426c6c27e3e5ba16f7a23149c00f4c.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_2047ce96c5acfac9f62843c04ae0f4c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ49630> (referer: https://www.auto1.com/v1/car-details-view/XZ49630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM52003> (referer: https://www.auto1.com/v1/car-details-view/UM52003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_19f77611012fddc209343c850a1ca7b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_82e86fe91940ecbeab31ef361ad37fd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ea317f8fb77ac86beaa7c58958020542.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_948249400d0ed68d0f126000a0b8c4cd.jpg not downloaded yet
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_862ee10aff5096764b4ebde46e4ab5eb.jpg not downloaded yet
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_d7df09f1b3e508addadfac8ffbdd8864.jpg not downloaded yet
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV76032> (referer: https://www.auto1.com/v1/car-details-view/WV76032/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22feb290>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_6f6c96e21f01334fc46fc9da19112d09.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300911d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_076706fe7643e88f2dae6a1dde3fa248.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR14791> (referer: https://www.auto1.com/v1/car-details-view/VR14791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_e6441633085544da9cbb25548899b022.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb4ee11d15df97fbfaa08c2de815ee9b.jpg not downloaded yet
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_401142260ef572c48bb8743cffc42b3c.jpg not downloaded yet
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_1253e956fd8df97d88853b86ea45f1f9.jpg not downloaded yet
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_4a902569fd3f947d098ebfcaa67aed55.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce7890>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_2047ce96c5acfac9f62843c04ae0f4c1.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with identifier: XZ49630
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_9ded608e951fc4a1eaa558732458776f.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e709108d-c454-5b2d-81b4-8774a3928399 with identifier: UM52003
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e709108d-c454-5b2d-81b4-8774a3928399 with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item e709108d-c454-5b2d-81b4-8774a3928399
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_de612f842fa3326fc3f9437cec563b10.jpg not downloaded yet
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecaad0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_19f77611012fddc209343c850a1ca7b8.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8ebd0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_82e86fe91940ecbeab31ef361ad37fd5.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c861d0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ea317f8fb77ac86beaa7c58958020542.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2f3adb-a805-5a69-92ea-05b46233db75 with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_db436e5de6007a8488dc1b31d1bdecc0.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_279e75aa67836541a6e8c8510283d6e1.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_93368b2fa1525ce399c83d9e280f561b.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_c2aae727ced19021ddf0ec7917bd54b7.jpg not downloaded yet
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb10893c7f2c98bd37df3dd134040470.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_855273d899824e728684e1cf455f344d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_2732b16845a847475d8ac3f82543606d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b09e816594452593928a577e0ecf280f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c682668f48b0903f4ef2ab24a71cb19c.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_df7fe9df1c3e80ee567473d61f3c784b.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_6b73d04e08192bac1bf76925bf4f83e7.jpg not downloaded yet
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_3ecb62f1c05b4620ba853d5e0ec6578d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_fd1ee5296dd78c3e397667da0f12df65.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5245c0bf1a70ab9bbb6bd269eacd8bd4.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da58999-8dc9-561c-a1b6-483d74eaefc4 with identifier: VR14791
2026-04-27 07:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da58999-8dc9-561c-a1b6-483d74eaefc4 with scrape type 1
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_a6b86de56afd0b5971ffc6a97e6990ab.jpg not downloaded yet
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed3210>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_e6441633085544da9cbb25548899b022.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b450>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_4a902569fd3f947d098ebfcaa67aed55.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c76f46201115458326e8ee50664a30bf.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_9efce4c9dfa3d36433165b08105315ee.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0c6dcc266b4fe0581398151d406aaba5.jpg not downloaded yet
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_d2c07cd0ad2886a5bd06a6ca74cf5487.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_c7d7ba6c51b7e36196e2adc5e2723166.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_c66165b96760233a505e47142189a0fd.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_855e065f941fb81522e6701fa3983c53.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_d23d153a4c00d5522e363324321f3286.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_0f4e5cf67b8e556514d4d9503e4d05b7.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_d9e499e4764bafb339d528803021c9e7.jpg not downloaded yet
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f1650>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb10893c7f2c98bd37df3dd134040470.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8f90>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_855273d899824e728684e1cf455f344d.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f87490>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_2732b16845a847475d8ac3f82543606d.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30141dd0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b09e816594452593928a577e0ecf280f.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8310>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_3ecb62f1c05b4620ba853d5e0ec6578d.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b2a23a3-62ea-5891-927c-d6187bbed390
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c58a82b5e90a23133ed3f49b8bb41dad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5fee7a0497f226e43a972b4b9a844a8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_8ee75d3cdb09dee6714a7d101e7e568c.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_8035aa259496061298c8c71ea6543007.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_36982ddb9ddcff37e1e0ed655226b58e.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_0d5760a69c5202ef5550251267a47f71.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_270789e71d5a22c37e428cf6562079a1.jpg not downloaded yet
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_ca719393baf41a17aa17ed679347654d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_862ee10aff5096764b4ebde46e4ab5eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_d7df09f1b3e508addadfac8ffbdd8864.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b54fcb9d3d577f1116e41bcffa971356.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_234850c1b50954f1017376812fa85521.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_b3b138bb51a85ac66cd05cfb7980969a.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_298c39222ad98b303ec950d533fefb8f.jpg not downloaded yet
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2fd10>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_d2c07cd0ad2886a5bd06a6ca74cf5487.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_437599971cb6b221701cc02b4a404a4f.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_c597c1aa47d3938d77bfd97bd34f3d7d.jpg not downloaded yet
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_c2aae727ced19021ddf0ec7917bd54b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_93368b2fa1525ce399c83d9e280f561b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_5d1e8f5218d2ccc4e7263a7a97cc56d8.jpg not downloaded yet
2026-04-27 07:54:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302792d0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c58a82b5e90a23133ed3f49b8bb41dad.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0b150>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5fee7a0497f226e43a972b4b9a844a8d.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_948249400d0ed68d0f126000a0b8c4cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_b657d27867efeee82000a97bb58b818c.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_66aa7d715d27474947ba745f9d7844e2.jpg not downloaded yet
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_de612f842fa3326fc3f9437cec563b10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_db436e5de6007a8488dc1b31d1bdecc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_cfaf8968e078ea5f2c2bd90963f9021d.jpg not downloaded yet
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0c6dcc266b4fe0581398151d406aaba5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_279e75aa67836541a6e8c8510283d6e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_2aea6d6698e65033a8fb0efc23e9e573.jpg not downloaded yet
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_9d3422b0d2c9b4cbad932adedd243476.jpg not downloaded yet
2026-04-27 07:54:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbd0d0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_ca719393baf41a17aa17ed679347654d.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2, skipping ID generation
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with scrape type 1
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 sending to next pipeline
2026-04-27 07:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2, identifier: RH00631
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f23ea10>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_862ee10aff5096764b4ebde46e4ab5eb.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcc510>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_d7df09f1b3e508addadfac8ffbdd8864.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b2a23a3-62ea-5891-927c-d6187bbed390
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2ab10>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b54fcb9d3d577f1116e41bcffa971356.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8d890>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_c2aae727ced19021ddf0ec7917bd54b7.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b2a23a3-62ea-5891-927c-d6187bbed390
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4c050>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_93368b2fa1525ce399c83d9e280f561b.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_c66165b96760233a505e47142189a0fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_4709880679f342943377270527266774.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with identifier: RH00631
2026-04-27 07:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with identifier: RH00631
2026-04-27 07:54:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2 with identifier: RH00631 to the API
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_ca719393baf41a17aa17ed679347654d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'city': 'Hilden',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:00:36Z',
 'fuel_type': 'diesel',
 'id': '6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.1694,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH00631',
 'listing': 'auction',
 'location': 'DE, Hilden',
 'location_confidence': 'geocoded',
 'longitude': 6.9253,
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 167445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c58a82b5e90a23133ed3f49b8bb41dad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_0c8050359a54f6799b00b3522642e6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c286de39109451ab84cbee7b502999cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_4b9e27f6255eb34757c29fe8bd5674f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_1ed6cf836cfd7cc993d791555fab47c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2244175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_ca719393baf41a17aa17ed679347654d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_daae670efbf06b02d3c44ff174c6b9fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_f85546a4de63359e6171a0a81b026bab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_954dbadf51204946f2a225666bce4ee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2/6e6d0ce3-b621-5ab7-bdd7-de56e0be39b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/3b/073b24dba32fd8c38a9f80aa384b8170/pa/RH00631_c501daf0c0060161e06139ae73926b5c.jpg',
             'Width': 800}],
 'postal_code': '40721',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Düsseldorf',
 'province_code': 'DE-051',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-11-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-04-27 07:54:41 [auto1.de] INFO: Saving data for RH00631: {'created_time': 1777276481.719474, 'last_price_update_time': 1777276481.719486, 'has_photos': True, 'auction_closing_time': 1777388436.0}
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_13e06514e86eeae784634df75fbfdd95.jpg not downloaded yet
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0309a8da0068b5e140ff2fa0d09645c8.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_855e065f941fb81522e6701fa3983c53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_0d4eaaa413619013f106acea105bc473.jpg not downloaded yet
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK31247> (referer: https://www.auto1.com/v1/car-details-view/YK31247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef87d0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_948249400d0ed68d0f126000a0b8c4cd.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30278890>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_de612f842fa3326fc3f9437cec563b10.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e709108d-c454-5b2d-81b4-8774a3928399
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f06910>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_db436e5de6007a8488dc1b31d1bdecc0.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30279210>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0c6dcc266b4fe0581398151d406aaba5.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffbd90>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_279e75aa67836541a6e8c8510283d6e1.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_dca54b9407ae3046cb534baf823fad63.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_efe7329327d4aadd1a9e8f61f630442c.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_5d1e8f5218d2ccc4e7263a7a97cc56d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_66aa7d715d27474947ba745f9d7844e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_b657d27867efeee82000a97bb58b818c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_437599971cb6b221701cc02b4a404a4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_935fe68ef842a650bdf75449afec971d.jpg not downloaded yet
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301beed0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_c66165b96760233a505e47142189a0fd.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_c597c1aa47d3938d77bfd97bd34f3d7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_cfaf8968e078ea5f2c2bd90963f9021d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_298c39222ad98b303ec950d533fefb8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_1c7eb9cd1fb282482293a90be53df30c.jpg not downloaded yet
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301be050>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_855e065f941fb81522e6701fa3983c53.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbce325a-0b86-5a6e-bbaf-b93b5415953e with identifier: YK31247
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbce325a-0b86-5a6e-bbaf-b93b5415953e with scrape type 1
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a742af711b715172677302f882cb6ce5.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_36982ddb9ddcff37e1e0ed655226b58e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_eb5f5bf594b7e6c0c841205cb27afdef.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_270789e71d5a22c37e428cf6562079a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46e10>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_5d1e8f5218d2ccc4e7263a7a97cc56d8.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e06050>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_66aa7d715d27474947ba745f9d7844e2.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff99d0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_b657d27867efeee82000a97bb58b818c.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30197950>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_437599971cb6b221701cc02b4a404a4f.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c8b50>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_c597c1aa47d3938d77bfd97bd34f3d7d.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302a98d0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_cfaf8968e078ea5f2c2bd90963f9021d.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b7a90>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_298c39222ad98b303ec950d533fefb8f.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_0d5760a69c5202ef5550251267a47f71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a2d3ecd3867f25db6849c615760b9ad3.jpg not downloaded yet
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_4709880679f342943377270527266774.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_b3b138bb51a85ac66cd05cfb7980969a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_234850c1b50954f1017376812fa85521.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_0d4eaaa413619013f106acea105bc473.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_73eb03a23bc750e5dd65f772c5a87ff4.jpg not downloaded yet
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005ba50>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_36982ddb9ddcff37e1e0ed655226b58e.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f06910>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_270789e71d5a22c37e428cf6562079a1.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0309a8da0068b5e140ff2fa0d09645c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_13e06514e86eeae784634df75fbfdd95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_efeebd1246cc2a92d5567316b354ec5e.jpg not downloaded yet
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_c6dfaba96f19f9c970136e295c718a43.jpg not downloaded yet
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c86050>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_0d5760a69c5202ef5550251267a47f71.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eeba50>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_4709880679f342943377270527266774.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb4c90>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_b3b138bb51a85ac66cd05cfb7980969a.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30298590>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_234850c1b50954f1017376812fa85521.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce5390>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_0d4eaaa413619013f106acea105bc473.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_1355ff793309b9203456cd06e2c54fe8.jpg not downloaded yet
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_1c7eb9cd1fb282482293a90be53df30c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_dca54b9407ae3046cb534baf823fad63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_2aea6d6698e65033a8fb0efc23e9e573.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a742af711b715172677302f882cb6ce5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_9d3422b0d2c9b4cbad932adedd243476.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_efe7329327d4aadd1a9e8f61f630442c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_935fe68ef842a650bdf75449afec971d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_943b59fad7839ad1456934214a768cc0.jpg not downloaded yet
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_25921c0ab524ac43adb700de82bdf88d.jpg not downloaded yet
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce4790>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0309a8da0068b5e140ff2fa0d09645c8.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b7ed0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_13e06514e86eeae784634df75fbfdd95.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_d9e499e4764bafb339d528803021c9e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_73eb03a23bc750e5dd65f772c5a87ff4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_8ee75d3cdb09dee6714a7d101e7e568c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a2d3ecd3867f25db6849c615760b9ad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_eb5f5bf594b7e6c0c841205cb27afdef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_8035aa259496061298c8c71ea6543007.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a619e9b495d1b7972c0c5f5f6e82f1cb.jpg not downloaded yet
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb7390>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_1c7eb9cd1fb282482293a90be53df30c.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017d290>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_dca54b9407ae3046cb534baf823fad63.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c00790>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_2aea6d6698e65033a8fb0efc23e9e573.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c2d0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a742af711b715172677302f882cb6ce5.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b7410>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_9d3422b0d2c9b4cbad932adedd243476.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4fa10>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_efe7329327d4aadd1a9e8f61f630442c.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167f50>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_935fe68ef842a650bdf75449afec971d.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_0f4e5cf67b8e556514d4d9503e4d05b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 92 pages/min), scraped 20 items (at 20 items/min)
2026-04-27 07:54:44 [scrapy.extensions.memusage] INFO: Peak memory usage is 383MiB
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30076310>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_d9e499e4764bafb339d528803021c9e7.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc89d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_73eb03a23bc750e5dd65f772c5a87ff4.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2c5d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_8ee75d3cdb09dee6714a7d101e7e568c.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcaf10>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a2d3ecd3867f25db6849c615760b9ad3.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee7810>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_eb5f5bf594b7e6c0c841205cb27afdef.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011ed10>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_8035aa259496061298c8c71ea6543007.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_1355ff793309b9203456cd06e2c54fe8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_d23d153a4c00d5522e363324321f3286.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c76f46201115458326e8ee50664a30bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_efeebd1246cc2a92d5567316b354ec5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_9efce4c9dfa3d36433165b08105315ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_c6dfaba96f19f9c970136e295c718a43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_c7d7ba6c51b7e36196e2adc5e2723166.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fbdfd0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_0f4e5cf67b8e556514d4d9503e4d05b7.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e709108d-c454-5b2d-81b4-8774a3928399
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_1abeffe6af25aebfa37d5676e2664dbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_a6b86de56afd0b5971ffc6a97e6990ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_943b59fad7839ad1456934214a768cc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce79d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_1355ff793309b9203456cd06e2c54fe8.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c682668f48b0903f4ef2ab24a71cb19c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_6b73d04e08192bac1bf76925bf4f83e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_9ded608e951fc4a1eaa558732458776f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_df7fe9df1c3e80ee567473d61f3c784b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30059c50>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_d23d153a4c00d5522e363324321f3286.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f37e50>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c76f46201115458326e8ee50664a30bf.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b41d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_efeebd1246cc2a92d5567316b354ec5e.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c23250>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_9efce4c9dfa3d36433165b08105315ee.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e709108d-c454-5b2d-81b4-8774a3928399
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d3d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_c6dfaba96f19f9c970136e295c718a43.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cadcd0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_c7d7ba6c51b7e36196e2adc5e2723166.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_25921c0ab524ac43adb700de82bdf88d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_fd1ee5296dd78c3e397667da0f12df65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5245c0bf1a70ab9bbb6bd269eacd8bd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a619e9b495d1b7972c0c5f5f6e82f1cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bb1d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_1abeffe6af25aebfa37d5676e2664dbd.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28, skipping ID generation
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 sending to next pipeline
2026-04-27 07:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28, identifier: GW94497
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f713d0>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_a6b86de56afd0b5971ffc6a97e6990ab.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da58999-8dc9-561c-a1b6-483d74eaefc4
2026-04-27 07:54:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da58999-8dc9-561c-a1b6-483d74eaefc4, skipping ID generation
2026-04-27 07:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da58999-8dc9-561c-a1b6-483d74eaefc4 with scrape type 1
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da58999-8dc9-561c-a1b6-483d74eaefc4 sending to next pipeline
2026-04-27 07:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4da58999-8dc9-561c-a1b6-483d74eaefc4, identifier: VR14791
2026-04-27 07:54:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e62750>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_943b59fad7839ad1456934214a768cc0.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f09250>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c682668f48b0903f4ef2ab24a71cb19c.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e1f410>
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_6b73d04e08192bac1bf76925bf4f83e7.jpg saved to cache
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb2f3adb-a805-5a69-92ea-05b46233db75
2026-04-27 07:54:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb2f3adb-a805-5a69-92ea-05b46233db75, skipping ID generation
2026-04-27 07:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2f3adb-a805-5a69-92ea-05b46233db75 with scrape type 1
2026-04-27 07:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb2f3adb-a805-5a69-92ea-05b46233db75 sending to next pipeline
2026-04-27 07:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb2f3adb-a805-5a69-92ea-05b46233db75, identifier: WV76032
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f62c3d0>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_9ded608e951fc4a1eaa558732458776f.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9
2026-04-27 07:54:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9, skipping ID generation
2026-04-27 07:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with scrape type 1
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 sending to next pipeline
2026-04-27 07:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9, identifier: XZ49630
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22caef90>
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_df7fe9df1c3e80ee567473d61f3c784b.jpg saved to cache
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e709108d-c454-5b2d-81b4-8774a3928399
2026-04-27 07:54:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e709108d-c454-5b2d-81b4-8774a3928399, skipping ID generation
2026-04-27 07:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e709108d-c454-5b2d-81b4-8774a3928399 with scrape type 1
2026-04-27 07:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e709108d-c454-5b2d-81b4-8774a3928399 sending to next pipeline
2026-04-27 07:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e709108d-c454-5b2d-81b4-8774a3928399, identifier: UM52003
2026-04-27 07:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with identifier: GW94497
2026-04-27 07:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with identifier: GW94497
2026-04-27 07:54:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28 with identifier: GW94497 to the API
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_1abeffe6af25aebfa37d5676e2664dbd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': 'Rental',
 'city': 'Göppingen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:44:48Z',
 'fuel_type': 'petrol',
 'id': 'a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.7075,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW94497',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'location_confidence': 'geocoded',
 'longitude': 9.6514,
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 96005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ab4f19f44b198857bf3a390188aca3fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_08f24f1804e00d8f00206f9c48f31901.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_8ab366eb4a2833d0c5b9157591e98e14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_e8426c6c27e3e5ba16f7a23149c00f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_076706fe7643e88f2dae6a1dde3fa248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_ea317f8fb77ac86beaa7c58958020542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_19f77611012fddc209343c850a1ca7b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_82e86fe91940ecbeab31ef361ad37fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_1abeffe6af25aebfa37d5676e2664dbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28/a2a43a5a-d00c-5777-9aa9-c1d80bbd9d28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/24/2e242536aecdccefaee424c5956f5ad1/pa/GW94497_d2c07cd0ad2886a5bd06a6ca74cf5487.jpg',
             'Width': 800}],
 'postal_code': '73033',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Stuttgart',
 'province_code': 'DE-081',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2012-04-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-04-27 07:54:46 [auto1.de] INFO: Saving data for GW94497: {'created_time': 1777276486.891639, 'last_price_update_time': 1777276486.891651, 'has_photos': True, 'auction_closing_time': 1777391088.0}
2026-04-27 07:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4da58999-8dc9-561c-a1b6-483d74eaefc4 with identifier: VR14791
2026-04-27 07:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4da58999-8dc9-561c-a1b6-483d74eaefc4 with identifier: VR14791
2026-04-27 07:54:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4da58999-8dc9-561c-a1b6-483d74eaefc4 with identifier: VR14791 to the API
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_a6b86de56afd0b5971ffc6a97e6990ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'city': 'Bayreuth',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:25:55Z',
 'fuel_type': 'petrol',
 'id': '4da58999-8dc9-561c-a1b6-483d74eaefc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.9461,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR14791',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'location_confidence': 'geocoded',
 'longitude': 11.5762,
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 114157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_a6b86de56afd0b5971ffc6a97e6990ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_855e065f941fb81522e6701fa3983c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_36982ddb9ddcff37e1e0ed655226b58e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_298c39222ad98b303ec950d533fefb8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_5d1e8f5218d2ccc4e7263a7a97cc56d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_cfaf8968e078ea5f2c2bd90963f9021d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_4709880679f342943377270527266774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_0d4eaaa413619013f106acea105bc473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_935fe68ef842a650bdf75449afec971d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da58999-8dc9-561c-a1b6-483d74eaefc4/4da58999-8dc9-561c-a1b6-483d74eaefc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/80/0b807a12b7c04a6bc7fcc02c3ce9cd69/pa/VR14791_1c7eb9cd1fb282482293a90be53df30c.jpg',
             'Width': 800}],
 'postal_code': '95444',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Franconia',
 'province_code': 'DE-094',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2020-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Diamant Edition+ 2WD',
 'transmission': 'automatic',
 'trim': 'Diamant Edition+ 2WD',
 'year': 2020}
2026-04-27 07:54:47 [auto1.de] INFO: Saving data for VR14791: {'created_time': 1777276487.300926, 'last_price_update_time': 1777276487.300939, 'has_photos': True, 'auction_closing_time': 1777389955.0}
2026-04-27 07:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-04-27 07:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-04-27 07:54:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032 to the API
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_6b73d04e08192bac1bf76925bf4f83e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Überherrn',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:28:46Z',
 'fuel_type': 'diesel',
 'id': 'bb2f3adb-a805-5a69-92ea-05b46233db75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV76032',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 240001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_db436e5de6007a8488dc1b31d1bdecc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_6b73d04e08192bac1bf76925bf4f83e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0c6dcc266b4fe0581398151d406aaba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_d9e499e4764bafb339d528803021c9e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_270789e71d5a22c37e428cf6562079a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_c597c1aa47d3938d77bfd97bd34f3d7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_66aa7d715d27474947ba745f9d7844e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_9d3422b0d2c9b4cbad932adedd243476.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_0309a8da0068b5e140ff2fa0d09645c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb2f3adb-a805-5a69-92ea-05b46233db75/bb2f3adb-a805-5a69-92ea-05b46233db75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/8a/8d8a0108ba128f7133669d41d96fc327/pa/WV76032_efe7329327d4aadd1a9e8f61f630442c.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2015-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-04-27 07:54:47 [auto1.de] INFO: Saving data for WV76032: {'created_time': 1777276487.679316, 'last_price_update_time': 1777276487.67933, 'has_photos': True, 'auction_closing_time': 1777390126.0}
2026-04-27 07:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with identifier: XZ49630
2026-04-27 07:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with identifier: XZ49630
2026-04-27 07:54:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9 with identifier: XZ49630 to the API
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_9ded608e951fc4a1eaa558732458776f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Karlskron',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:40:37Z',
 'fuel_type': 'diesel',
 'id': 'ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ49630',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 150319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_9ded608e951fc4a1eaa558732458776f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c682668f48b0903f4ef2ab24a71cb19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_c76f46201115458326e8ee50664a30bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_d23d153a4c00d5522e363324321f3286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_0d5760a69c5202ef5550251267a47f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_437599971cb6b221701cc02b4a404a4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_b657d27867efeee82000a97bb58b818c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_2aea6d6698e65033a8fb0efc23e9e573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_13e06514e86eeae784634df75fbfdd95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9/ff4dfe7e-a1b6-5afb-a1cf-8db1e8ee93a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/ba/8aba46691fb7b4f359f4795c9ed6faeb/pa/XZ49630_dca54b9407ae3046cb534baf823fad63.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueTDI',
 'transmission': 'manual',
 'trim': 'Highline BlueTDI',
 'year': 2014}
2026-04-27 07:54:48 [auto1.de] INFO: Saving data for XZ49630: {'created_time': 1777276488.061916, 'last_price_update_time': 1777276488.061928, 'has_photos': True, 'auction_closing_time': 1777390837.0}
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e709108d-c454-5b2d-81b4-8774a3928399 with identifier: UM52003
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e709108d-c454-5b2d-81b4-8774a3928399 with identifier: UM52003
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e709108d-c454-5b2d-81b4-8774a3928399 with identifier: UM52003 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_df7fe9df1c3e80ee567473d61f3c784b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:58:11Z',
 'fuel_type': 'diesel',
 'id': 'e709108d-c454-5b2d-81b4-8774a3928399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM52003',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 143092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_de612f842fa3326fc3f9437cec563b10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_df7fe9df1c3e80ee567473d61f3c784b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_9efce4c9dfa3d36433165b08105315ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e709108d-c454-5b2d-81b4-8774a3928399/e709108d-c454-5b2d-81b4-8774a3928399_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/10/ad102d5ef1b81c8f108e152825b7086f/pa/UM52003_0f4e5cf67b8e556514d4d9503e4d05b7.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-03-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2023}
2026-04-27 07:54:48 [auto1.de] INFO: Saving data for UM52003: {'created_time': 1777276488.609166, 'last_price_update_time': 1777276488.609178, 'has_photos': True, 'auction_closing_time': 1777391891.0}
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_ee23a9219d2ba500edd153f5bf342288.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_401142260ef572c48bb8743cffc42b3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb4ee11d15df97fbfaa08c2de815ee9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_1253e956fd8df97d88853b86ea45f1f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_733ca5cdd99ae82e29bad414bea0cd77.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_57ec73c879ed0cb5d972c0163fea58d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_a4cda1e2a8baad84029c4899d7b81170.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_4a3b688c77aba761f31b85eb9ffca84a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e27b90>
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_25921c0ab524ac43adb700de82bdf88d.jpg saved to cache
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c44f50>
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_fd1ee5296dd78c3e397667da0f12df65.jpg saved to cache
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004b4d0>
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5245c0bf1a70ab9bbb6bd269eacd8bd4.jpg saved to cache
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da35d0>
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a619e9b495d1b7972c0c5f5f6e82f1cb.jpg saved to cache
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbce325a-0b86-5a6e-bbaf-b93b5415953e
2026-04-27 07:54:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbce325a-0b86-5a6e-bbaf-b93b5415953e, skipping ID generation
2026-04-27 07:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbce325a-0b86-5a6e-bbaf-b93b5415953e with scrape type 1
2026-04-27 07:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbce325a-0b86-5a6e-bbaf-b93b5415953e sending to next pipeline
2026-04-27 07:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbce325a-0b86-5a6e-bbaf-b93b5415953e, identifier: YK31247
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbce325a-0b86-5a6e-bbaf-b93b5415953e with identifier: YK31247
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbce325a-0b86-5a6e-bbaf-b93b5415953e with identifier: YK31247
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbce325a-0b86-5a6e-bbaf-b93b5415953e with identifier: YK31247 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a619e9b495d1b7972c0c5f5f6e82f1cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-04-28T15:19:51Z',
 'fuel_type': 'diesel',
 'id': 'fbce325a-0b86-5a6e-bbaf-b93b5415953e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK31247',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 119583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a742af711b715172677302f882cb6ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_eb5f5bf594b7e6c0c841205cb27afdef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a2d3ecd3867f25db6849c615760b9ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_73eb03a23bc750e5dd65f772c5a87ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_efeebd1246cc2a92d5567316b354ec5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_c6dfaba96f19f9c970136e295c718a43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_1355ff793309b9203456cd06e2c54fe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_943b59fad7839ad1456934214a768cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_25921c0ab524ac43adb700de82bdf88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fbce325a-0b86-5a6e-bbaf-b93b5415953e/fbce325a-0b86-5a6e-bbaf-b93b5415953e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f3/b3f317305b9f95e3715d170ffe407985/pa/YK31247_a619e9b495d1b7972c0c5f5f6e82f1cb.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2019-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2019}
2026-04-27 07:54:49 [auto1.de] INFO: Saving data for YK31247: {'created_time': 1777276489.485765, 'last_price_update_time': 1777276489.485784, 'has_photos': True, 'auction_closing_time': 1777389591.0}
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_edd8a7fe96327669eec3f1fd4d9a81e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003b650>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_ee23a9219d2ba500edd153f5bf342288.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcb950>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_401142260ef572c48bb8743cffc42b3c.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a
2026-04-27 07:54:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a, skipping ID generation
2026-04-27 07:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with scrape type 1
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36ddaf30-fa56-5f58-a3ea-fb4b4642937a sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a, identifier: XT69507
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebb250>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb4ee11d15df97fbfaa08c2de815ee9b.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baa48293-f5af-5f04-bd19-f48f7b1dbdfe, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baa48293-f5af-5f04-bd19-f48f7b1dbdfe sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baa48293-f5af-5f04-bd19-f48f7b1dbdfe, identifier: RV68126
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f52810>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_1253e956fd8df97d88853b86ea45f1f9.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b2a23a3-62ea-5891-927c-d6187bbed390
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b2a23a3-62ea-5891-927c-d6187bbed390, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2a23a3-62ea-5891-927c-d6187bbed390 with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b2a23a3-62ea-5891-927c-d6187bbed390 sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b2a23a3-62ea-5891-927c-d6187bbed390, identifier: ET41038
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ad390>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_733ca5cdd99ae82e29bad414bea0cd77.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5215c012-8fa8-5c05-b1c8-49bc2039d333
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5215c012-8fa8-5c05-b1c8-49bc2039d333, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5215c012-8fa8-5c05-b1c8-49bc2039d333 with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5215c012-8fa8-5c05-b1c8-49bc2039d333 sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5215c012-8fa8-5c05-b1c8-49bc2039d333, identifier: GM08023
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3e1d0>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_57ec73c879ed0cb5d972c0163fea58d0.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c96270c-f8aa-5a98-902f-e330046e715f
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c96270c-f8aa-5a98-902f-e330046e715f, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c96270c-f8aa-5a98-902f-e330046e715f with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c96270c-f8aa-5a98-902f-e330046e715f sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c96270c-f8aa-5a98-902f-e330046e715f, identifier: WE17862
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e06990>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_a4cda1e2a8baad84029c4899d7b81170.jpg saved to cache
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2648436b-04ff-5e54-a84b-cd12de005d49
2026-04-27 07:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2648436b-04ff-5e54-a84b-cd12de005d49, skipping ID generation
2026-04-27 07:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2648436b-04ff-5e54-a84b-cd12de005d49 with scrape type 1
2026-04-27 07:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2648436b-04ff-5e54-a84b-cd12de005d49 sending to next pipeline
2026-04-27 07:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2648436b-04ff-5e54-a84b-cd12de005d49, identifier: DL59919
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff8f50>
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_4a3b688c77aba761f31b85eb9ffca84a.jpg saved to cache
2026-04-27 07:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_ac810edb335077b23bd6b6e7819b605f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_192d8ef960a77b3e946d248a33c7f50c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7bebe3e0c95d90ee736c842518bd4d20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_9f2c419272c94223c838331cc4010e0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with identifier: XT69507
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with identifier: XT69507
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36ddaf30-fa56-5f58-a3ea-fb4b4642937a with identifier: XT69507 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_401142260ef572c48bb8743cffc42b3c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '36ddaf30-fa56-5f58-a3ea-fb4b4642937a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT69507',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 83671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5fee7a0497f226e43a972b4b9a844a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_2732b16845a847475d8ac3f82543606d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_855273d899824e728684e1cf455f344d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_862ee10aff5096764b4ebde46e4ab5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_401142260ef572c48bb8743cffc42b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_93368b2fa1525ce399c83d9e280f561b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_5245c0bf1a70ab9bbb6bd269eacd8bd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_c66165b96760233a505e47142189a0fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_8035aa259496061298c8c71ea6543007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_36ddaf30-fa56-5f58-a3ea-fb4b4642937a/36ddaf30-fa56-5f58-a3ea-fb4b4642937a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/88/60884520b7cf2c85d445693cb6ccb5c6/pa/XT69507_b3b138bb51a85ac66cd05cfb7980969a.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2009-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-04-27 07:54:51 [auto1.de] INFO: Saving data for XT69507: {'created_time': 1777276491.38558, 'last_price_update_time': 1777276491.385594, 'has_photos': True, 'auction_closing_time': 1777390218.0}
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baa48293-f5af-5f04-bd19-f48f7b1dbdfe with identifier: RV68126
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baa48293-f5af-5f04-bd19-f48f7b1dbdfe with identifier: RV68126
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baa48293-f5af-5f04-bd19-f48f7b1dbdfe with identifier: RV68126 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb4ee11d15df97fbfaa08c2de815ee9b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'city': 'Ellerau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:36:31Z',
 'fuel_type': 'petrol',
 'id': 'baa48293-f5af-5f04-bd19-f48f7b1dbdfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV68126',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 64939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b54fcb9d3d577f1116e41bcffa971356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_b09e816594452593928a577e0ecf280f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb10893c7f2c98bd37df3dd134040470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_948249400d0ed68d0f126000a0b8c4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_cb4ee11d15df97fbfaa08c2de815ee9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_279e75aa67836541a6e8c8510283d6e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_fd1ee5296dd78c3e397667da0f12df65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_c7d7ba6c51b7e36196e2adc5e2723166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_8ee75d3cdb09dee6714a7d101e7e568c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_baa48293-f5af-5f04-bd19-f48f7b1dbdfe/baa48293-f5af-5f04-bd19-f48f7b1dbdfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/8c/148cf6f67eeb100812db745a45639aef/pa/RV68126_234850c1b50954f1017376812fa85521.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2008-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-04-27 07:54:51 [auto1.de] INFO: Saving data for RV68126: {'created_time': 1777276491.805518, 'last_price_update_time': 1777276491.805528, 'has_photos': True, 'auction_closing_time': 1777390591.0}
2026-04-27 07:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b2a23a3-62ea-5891-927c-d6187bbed390 with identifier: ET41038
2026-04-27 07:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b2a23a3-62ea-5891-927c-d6187bbed390 with identifier: ET41038
2026-04-27 07:54:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b2a23a3-62ea-5891-927c-d6187bbed390 with identifier: ET41038 to the API
2026-04-27 07:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_1253e956fd8df97d88853b86ea45f1f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:31:03Z',
 'fuel_type': 'diesel',
 'id': '6b2a23a3-62ea-5891-927c-d6187bbed390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET41038',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 273161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131698,
             'Height': 599,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_3ecb62f1c05b4620ba853d5e0ec6578d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_d7df09f1b3e508addadfac8ffbdd8864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84545,
             'Height': 599,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_1253e956fd8df97d88853b86ea45f1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b2a23a3-62ea-5891-927c-d6187bbed390/6b2a23a3-62ea-5891-927c-d6187bbed390_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db94b075c591bde012a5825c3166af/pa/ET41038_c2aae727ced19021ddf0ec7917bd54b7.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-09-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten lang FWD',
 'transmission': 'manual',
 'trim': 'Kasten lang FWD',
 'year': 2023}
2026-04-27 07:54:52 [auto1.de] INFO: Saving data for ET41038: {'created_time': 1777276492.200593, 'last_price_update_time': 1777276492.200605, 'has_photos': True, 'auction_closing_time': 1777390263.0}
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5215c012-8fa8-5c05-b1c8-49bc2039d333 with identifier: GM08023
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5215c012-8fa8-5c05-b1c8-49bc2039d333 with identifier: GM08023
2026-04-27 07:54:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5215c012-8fa8-5c05-b1c8-49bc2039d333 with identifier: GM08023 to the API
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_733ca5cdd99ae82e29bad414bea0cd77.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Seddiner See',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 80,
 'expiration_date': '2026-04-28T15:57:36Z',
 'fuel_type': 'petrol',
 'id': '5215c012-8fa8-5c05-b1c8-49bc2039d333',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM08023',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 113030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_733ca5cdd99ae82e29bad414bea0cd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_129e0eaddf6431405c701ab5a47e7efa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_26946dcad6c87b3d50496b149989f89d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_02f740b33a2284dcb2ef5f15cde21e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_7437b7f1c2eb0e2203b8b7828eb20499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_99a856f279fa1f9ed9a14c5c67c081a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_0f5ef534e8e721fe1f9bbc7ad567d675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_f247339558aaca6dfa7bf45b4fd35249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_79ab203873ca1a1ea2c5f910e83df676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5215c012-8fa8-5c05-b1c8-49bc2039d333/5215c012-8fa8-5c05-b1c8-49bc2039d333_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ee/c4ee9de8296511d63fbc6b66d3dd1094/pa/GM08023_ea5fc707627ca6472eb2f565ee77dbbc.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2016-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-04-27 07:54:52 [auto1.de] INFO: Saving data for GM08023: {'created_time': 1777276492.705916, 'last_price_update_time': 1777276492.705929, 'has_photos': True, 'auction_closing_time': 1777391856.0}
2026-04-27 07:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c96270c-f8aa-5a98-902f-e330046e715f with identifier: WE17862
2026-04-27 07:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c96270c-f8aa-5a98-902f-e330046e715f with identifier: WE17862
2026-04-27 07:54:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c96270c-f8aa-5a98-902f-e330046e715f with identifier: WE17862 to the API
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_57ec73c879ed0cb5d972c0163fea58d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Seddiner See',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:27:09Z',
 'fuel_type': 'petrol',
 'id': '3c96270c-f8aa-5a98-902f-e330046e715f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE17862',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'BMW',
 'model': '3er',
 'odometer': 102562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_57ec73c879ed0cb5d972c0163fea58d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_ee23a9219d2ba500edd153f5bf342288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_61cbe33edc77cd9f7e48e80c0160b8c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_4a902569fd3f947d098ebfcaa67aed55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_12fe862887e39c0d6d08f86a8282a03d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_8d665a948a9ef505d9444d04098cac24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_2047ce96c5acfac9f62843c04ae0f4c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_328f402714efa79dafe5c8e36050a6f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_fcf43a0da53ecbac420204698f986128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c96270c-f8aa-5a98-902f-e330046e715f/3c96270c-f8aa-5a98-902f-e330046e715f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e6adb8cd180c2114466c53d3d44729/pa/WE17862_6f6c96e21f01334fc46fc9da19112d09.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2001-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-04-27 07:54:53 [auto1.de] INFO: Saving data for WE17862: {'created_time': 1777276493.073312, 'last_price_update_time': 1777276493.073323, 'has_photos': True, 'auction_closing_time': 1777390029.0}
2026-04-27 07:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2648436b-04ff-5e54-a84b-cd12de005d49 with identifier: DL59919
2026-04-27 07:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2648436b-04ff-5e54-a84b-cd12de005d49 with identifier: DL59919
2026-04-27 07:54:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2648436b-04ff-5e54-a84b-cd12de005d49 with identifier: DL59919 to the API
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_a4cda1e2a8baad84029c4899d7b81170.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:08:20Z',
 'fuel_type': 'petrol',
 'id': '2648436b-04ff-5e54-a84b-cd12de005d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL59919',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 125337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_a4cda1e2a8baad84029c4899d7b81170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_e6441633085544da9cbb25548899b022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_9a43ef19392f5508f64ddd69e6947d1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_dee822bb989a77b9b52a58b0f1ef5669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2648436b-04ff-5e54-a84b-cd12de005d49/2648436b-04ff-5e54-a84b-cd12de005d49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/90/cb90906691e613ca4fda32f46a9c8d7d/pa/DL59919_2c99c3d09bb77e8b0311359acdc96ce7.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2005-06-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Sport Edition',
 'transmission': 'automatic',
 'trim': 'Sport Edition',
 'year': 2005}
2026-04-27 07:54:53 [auto1.de] INFO: Saving data for DL59919: {'created_time': 1777276493.658341, 'last_price_update_time': 1777276493.658356, 'has_photos': True, 'auction_closing_time': 1777388900.0}
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f0a9485d1de2aff66e8a0c1174b9108.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB78369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS85819> (referer: https://www.auto1.com/v1/car-details-view/WS85819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA35415> (referer: https://www.auto1.com/v1/car-details-view/DA35415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW55153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6f0d0>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_edd8a7fe96327669eec3f1fd4d9a81e0.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be98ca77-db8a-53cd-891e-d3f1e8cced78
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be98ca77-db8a-53cd-891e-d3f1e8cced78, skipping ID generation
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be98ca77-db8a-53cd-891e-d3f1e8cced78 with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be98ca77-db8a-53cd-891e-d3f1e8cced78 sending to next pipeline
2026-04-27 07:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be98ca77-db8a-53cd-891e-d3f1e8cced78, identifier: RL26788
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6c610>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_ac810edb335077b23bd6b6e7819b605f.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e61250>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_192d8ef960a77b3e946d248a33c7f50c.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7addd0>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7bebe3e0c95d90ee736c842518bd4d20.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fed190>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_9f2c419272c94223c838331cc4010e0c.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be98ca77-db8a-53cd-891e-d3f1e8cced78 with identifier: RL26788
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-04-27 07:54:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be98ca77-db8a-53cd-891e-d3f1e8cced78 with identifier: RL26788
2026-04-27 07:54:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be98ca77-db8a-53cd-891e-d3f1e8cced78 with identifier: RL26788 to the API
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_edd8a7fe96327669eec3f1fd4d9a81e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:43:42Z',
 'fuel_type': 'petrol',
 'id': 'be98ca77-db8a-53cd-891e-d3f1e8cced78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL26788',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 150049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_edd8a7fe96327669eec3f1fd4d9a81e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_4a3b688c77aba761f31b85eb9ffca84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_52b671695c3aaf90edd65a4f3e991d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_f59b06963988e5244bb11a02a9bae017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e11e8efaec82dbef722cba82cee42c70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be98ca77-db8a-53cd-891e-d3f1e8cced78/be98ca77-db8a-53cd-891e-d3f1e8cced78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/3d/273de024ecfa1eaec7f5cb8150edec4d/pa/RL26788_e26c8293b0cd8ec6540df4e9cacb10a4.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2016-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Cool&Sound',
 'transmission': 'manual',
 'trim': 'Cool&Sound',
 'year': 2016}
2026-04-27 07:54:54 [auto1.de] INFO: Saving data for RL26788: {'created_time': 1777276494.775475, 'last_price_update_time': 1777276494.775488, 'has_photos': True, 'auction_closing_time': 1777391022.0}
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f55e2a1bd7812db1c268a037d4611e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_e101af8f40e3c3f63ac2b23f595b9d23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT80082> (referer: https://www.auto1.com/v1/car-details-view/VT80082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE20387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cead50>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f0a9485d1de2aff66e8a0c1174b9108.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with identifier: WS85819
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_63c5e808cd8d766a787a3a7b1af55f2a.png not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with identifier: DA35415
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_00903f840db3efb1c3eda93247639ec7.jpg not downloaded yet
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_34b1151d00a71dd5dfc34ac647b03edb.png not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_0083224f361a6eca81f027b88cf5eaf9.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_6f405916ffd4d0ece5a43bdfafea0c7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ29416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_0863c15a94483bc176737650457ccdb8.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_641bce76040e1075b6a8e4578fb41cf6.jpg not downloaded yet
2026-04-27 07:54:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fec190>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f55e2a1bd7812db1c268a037d4611e4.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e950>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_e101af8f40e3c3f63ac2b23f595b9d23.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7298fb42-3757-5f25-b5a4-1ab525683bd0 with identifier: VT80082
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7298fb42-3757-5f25-b5a4-1ab525683bd0 with scrape type 1
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_fd1d2c649d941135709f6ad458dcfdcc.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_edfa01128ca23a8a1105def64bef719c.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_2a0fb9ca8b355b45ca15657f4e3abdce.jpg not downloaded yet
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_00903f840db3efb1c3eda93247639ec7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_35e2ebf4de73519731a729008a5a2301.jpg not downloaded yet
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4eb90>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_6f405916ffd4d0ece5a43bdfafea0c7f.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3100d070-8b2d-5237-8906-819b44a658d6
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3100d070-8b2d-5237-8906-819b44a658d6, skipping ID generation
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3100d070-8b2d-5237-8906-819b44a658d6 with scrape type 1
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3100d070-8b2d-5237-8906-819b44a658d6 sending to next pipeline
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3100d070-8b2d-5237-8906-819b44a658d6, identifier: CF30803
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_d13e7b1a01b8bd674040792fc63a4bc2.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3100d070-8b2d-5237-8906-819b44a658d6 with identifier: CF30803
2026-04-27 07:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3100d070-8b2d-5237-8906-819b44a658d6 with identifier: CF30803
2026-04-27 07:54:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3100d070-8b2d-5237-8906-819b44a658d6 with identifier: CF30803 to the API
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_6f405916ffd4d0ece5a43bdfafea0c7f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:40:31Z',
 'fuel_type': 'diesel',
 'id': '3100d070-8b2d-5237-8906-819b44a658d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF30803',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 94290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_6f405916ffd4d0ece5a43bdfafea0c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f55e2a1bd7812db1c268a037d4611e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_e101af8f40e3c3f63ac2b23f595b9d23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_9f2c419272c94223c838331cc4010e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7bebe3e0c95d90ee736c842518bd4d20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_2f0a9485d1de2aff66e8a0c1174b9108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_192d8ef960a77b3e946d248a33c7f50c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_ac810edb335077b23bd6b6e7819b605f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_7a7427cc444bd0b33532d323721f8a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3100d070-8b2d-5237-8906-819b44a658d6/3100d070-8b2d-5237-8906-819b44a658d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/a2/fea2be7b3b040c952a7d9f1133cef597/pa/CF30803_b35920e68b954d6d189cfbf0a9f0abd4.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2012-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Antara 2.2 CDTI Design Edition 4x4',
 'transmission': 'manual',
 'trim': 'Design Edition 4x4',
 'year': 2012}
2026-04-27 07:54:55 [auto1.de] INFO: Saving data for CF30803: {'created_time': 1777276495.893036, 'last_price_update_time': 1777276495.893048, 'has_photos': True, 'auction_closing_time': 1777390831.0}
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_0083224f361a6eca81f027b88cf5eaf9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_db9eeea7fa620687fdf192d26c780038.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b75d015466e4aaccb3620e71fb5e8c9e.jpg not downloaded yet
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7df50>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_00903f840db3efb1c3eda93247639ec7.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_4114607f6b57767bf53df8b72d95dc78.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX62478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_1fa1e9e9f650903309fb0b63bb71b9c9.jpg not downloaded yet
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_574c3141bb8031ff9a76ebb6a9480b43.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_9886a8906fad7924e38ebd66e27902d4.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7c3a3f23d4d3b4ea700f93c4797359c9.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fb290>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_0083224f361a6eca81f027b88cf5eaf9.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b1ebeb4662e458f796c06f4f3a8ddcfd.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK84276> (referer: https://www.auto1.com/v1/car-details-view/XK84276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_d13e7b1a01b8bd674040792fc63a4bc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7a5f8f2fddce840293d3b03f0339a592.jpg not downloaded yet
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_78543303736a04ad3a71a55c5cd0926e.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_e5a35df28fdc46badf94e1fbbde07580.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_63c5e808cd8d766a787a3a7b1af55f2a.png> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b75d015466e4aaccb3620e71fb5e8c9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_60342c98576731ceb873e6215bf9b4ab.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_d9849dee5a49afd0e7e2aa41f81471ba.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb2b375-319f-5aad-8bd0-67e64faa046a with identifier: XK84276
2026-04-27 07:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb2b375-319f-5aad-8bd0-67e64faa046a with scrape type 1
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2140a446728decea46e8d216bf24fcfd.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1f10>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_d13e7b1a01b8bd674040792fc63a4bc2.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_9886a8906fad7924e38ebd66e27902d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_8d2e99632118687a8cda71c2b336a202.jpg not downloaded yet
2026-04-27 07:54:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:54:56 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:54:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b11010>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_0.png HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_63c5e808cd8d766a787a3a7b1af55f2a.png saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e16710>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b75d015466e4aaccb3620e71fb5e8c9e.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_78543303736a04ad3a71a55c5cd0926e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_80974d0b08f6b30e91b729b091369b0a.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7c3a3f23d4d3b4ea700f93c4797359c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b56a36b3c8776fe4e54b6ee6d5c65ca0.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb15d0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_9886a8906fad7924e38ebd66e27902d4.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_e354206fe00f16fe7b7a040a0996a27f.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2140a446728decea46e8d216bf24fcfd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2a7e55593224131c2b191d6808f07d3e.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad850>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_78543303736a04ad3a71a55c5cd0926e.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d78ad0>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7c3a3f23d4d3b4ea700f93c4797359c9.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_28215bfb12be10041864ea3ac0ca2a6a.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_8d2e99632118687a8cda71c2b336a202.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_169f11dc33da0a2536cc2550b2776546.jpg not downloaded yet
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026fc50>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2140a446728decea46e8d216bf24fcfd.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC11125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b9e31e63157e0ef15b310af8b98ec060.jpg not downloaded yet
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR59159> (referer: https://www.auto1.com/v1/car-details-view/YR59159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK16008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_7195349eb083c9b38693b1f2bf32310f.jpg not downloaded yet
2026-04-27 07:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9010>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_8d2e99632118687a8cda71c2b336a202.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b56a36b3c8776fe4e54b6ee6d5c65ca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2a7e55593224131c2b191d6808f07d3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b9e31e63157e0ef15b310af8b98ec060.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG92624> (referer: https://www.auto1.com/v1/car-details-view/CG92624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH71731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_169f11dc33da0a2536cc2550b2776546.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6acb802a-52aa-5874-b590-8bd8f3613f8f with identifier: YR59159
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acb802a-52aa-5874-b590-8bd8f3613f8f with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a6c4305d3d91d6254df986b9be4e1d15.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_97820c132ba386983f079f2e39afed22.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_28215bfb12be10041864ea3ac0ca2a6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_419659a6af768fd550b60c6fd10241a5.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_821e7552e535937fe2b68f7b30eb6fcf.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_4b898a440a6eb717cbe6c8cad5d35918.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7a5f8f2fddce840293d3b03f0339a592.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a56eece7453aaeb086fdcb7d78ffabb4.jpg not downloaded yet
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c30b10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b56a36b3c8776fe4e54b6ee6d5c65ca0.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_e5da6a5a565bf1065679270f4d5ec692.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_7195349eb083c9b38693b1f2bf32310f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e17450>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2a7e55593224131c2b191d6808f07d3e.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4f510>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b9e31e63157e0ef15b310af8b98ec060.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e927264e-ea42-529f-9afb-b47ee3cd5567 with identifier: CG92624
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e927264e-ea42-529f-9afb-b47ee3cd5567 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_5b34e9875cab81809b05c510691aa341.jpg not downloaded yet
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e950>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_169f11dc33da0a2536cc2550b2776546.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1050>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_28215bfb12be10041864ea3ac0ca2a6a.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_08c9c8e9ff31f5134860f69fe7511475.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_e354206fe00f16fe7b7a040a0996a27f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_e5a35df28fdc46badf94e1fbbde07580.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_119b5263e68d3e48344dc624386411f3.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_80974d0b08f6b30e91b729b091369b0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_97820c132ba386983f079f2e39afed22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_0af0b11990ac44244afc17ad43b5eea8.jpg not downloaded yet
2026-04-27 07:54:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4fb10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7a5f8f2fddce840293d3b03f0339a592.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007a4d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_7195349eb083c9b38693b1f2bf32310f.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_ef669ba07bda8c678f7c70507c713970.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_2bff4d369bfea84ca9cf3663e3d1a222.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a56eece7453aaeb086fdcb7d78ffabb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_c5d00282d023807f02edac5d5751924a.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH23682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93d50>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_e354206fe00f16fe7b7a040a0996a27f.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f7ae50>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_e5a35df28fdc46badf94e1fbbde07580.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e245d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_80974d0b08f6b30e91b729b091369b0a.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eb2b375-319f-5aad-8bd0-67e64faa046a
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eb2b375-319f-5aad-8bd0-67e64faa046a, skipping ID generation
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb2b375-319f-5aad-8bd0-67e64faa046a with scrape type 1
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eb2b375-319f-5aad-8bd0-67e64faa046a sending to next pipeline
2026-04-27 07:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0eb2b375-319f-5aad-8bd0-67e64faa046a, identifier: XK84276
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e87f10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_97820c132ba386983f079f2e39afed22.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_d9849dee5a49afd0e7e2aa41f81471ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0eb2b375-319f-5aad-8bd0-67e64faa046a with identifier: XK84276
2026-04-27 07:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0eb2b375-319f-5aad-8bd0-67e64faa046a with identifier: XK84276
2026-04-27 07:54:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0eb2b375-319f-5aad-8bd0-67e64faa046a with identifier: XK84276 to the API
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_80974d0b08f6b30e91b729b091369b0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-04-28T15:39:12Z',
 'fuel_type': 'petrol',
 'id': '0eb2b375-319f-5aad-8bd0-67e64faa046a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK84276',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 85999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2140a446728decea46e8d216bf24fcfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_8d2e99632118687a8cda71c2b336a202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_80974d0b08f6b30e91b729b091369b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b56a36b3c8776fe4e54b6ee6d5c65ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_e354206fe00f16fe7b7a040a0996a27f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_2a7e55593224131c2b191d6808f07d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_28215bfb12be10041864ea3ac0ca2a6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_169f11dc33da0a2536cc2550b2776546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_b9e31e63157e0ef15b310af8b98ec060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0eb2b375-319f-5aad-8bd0-67e64faa046a/0eb2b375-319f-5aad-8bd0-67e64faa046a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/46/bd46b2611c8eb43b7b421e938743780c/pa/XK84276_7195349eb083c9b38693b1f2bf32310f.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-05-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2015}
2026-04-27 07:54:58 [auto1.de] INFO: Saving data for XK84276: {'created_time': 1777276498.900662, 'last_price_update_time': 1777276498.900674, 'has_photos': True, 'auction_closing_time': 1777390752.0}
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_6e8ed8e98150fc59dd3d15f280d0703a.jpg not downloaded yet
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_5b34e9875cab81809b05c510691aa341.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_e5da6a5a565bf1065679270f4d5ec692.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_08c9c8e9ff31f5134860f69fe7511475.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA09149/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT24797/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE20387> (referer: https://www.auto1.com/v1/car-details-view/FE20387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd55d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a56eece7453aaeb086fdcb7d78ffabb4.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_1ae764d77ec76c58b3fdfd79003bfee1.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX62478> (referer: https://www.auto1.com/v1/car-details-view/XX62478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW55153> (referer: https://www.auto1.com/v1/car-details-view/JW55153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea790>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_d9849dee5a49afd0e7e2aa41f81471ba.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_ef669ba07bda8c678f7c70507c713970.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_2bff4d369bfea84ca9cf3663e3d1a222.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_f53c27ebe087c73d495f451f83f767d0.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE47828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed3290>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_5b34e9875cab81809b05c510691aa341.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcf7d0>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_e5da6a5a565bf1065679270f4d5ec692.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb95d0>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_08c9c8e9ff31f5134860f69fe7511475.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ef064f-8ab2-5278-ab38-db3961e127cf with identifier: FE20387
2026-04-27 07:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ef064f-8ab2-5278-ab38-db3961e127cf with scrape type 1
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_a3f56652ce03956ad13712e040f06256.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_c5d00282d023807f02edac5d5751924a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_7998dcc66474fbb97eb9689f19175916.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_708b2924fbadb10c74b7c1321a450cfe.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_821e7552e535937fe2b68f7b30eb6fcf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_119b5263e68d3e48344dc624386411f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7574b9c9-efe4-5514-bbae-16d2f6621c86 with identifier: XX62478
2026-04-27 07:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7574b9c9-efe4-5514-bbae-16d2f6621c86 with scrape type 1
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_a9842b28a87b76b11f529cc99922d5ff.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with identifier: JW55153
2026-04-27 07:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with scrape type 1
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_0c8b5033d4c27dc5fe0f59d9352661da.jpg not downloaded yet
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f9c90>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_ef669ba07bda8c678f7c70507c713970.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ca750>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_2bff4d369bfea84ca9cf3663e3d1a222.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_24667af7e1bbb7ef377986df0e4951d5.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_e7c10f14945f75b2a1caa965b8d75e36.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_6e8ed8e98150fc59dd3d15f280d0703a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_05ff4a45231000d4aeb973b6f7066fa0.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_b110bfa29b0692b344b614c956b17fdc.jpg not downloaded yet
2026-04-27 07:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a6c4305d3d91d6254df986b9be4e1d15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_0d689a383eb20c05d66cbce19ac94652.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_429c33b34232e2db536d72cccf1f3393.jpg not downloaded yet
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_419659a6af768fd550b60c6fd10241a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b1ebeb4662e458f796c06f4f3a8ddcfd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_d008f128bfa8989e1a9bf5e82f2a26ba.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_d18e86ca4b155e0d2283db0c988ed2f0.jpg not downloaded yet
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea2c50>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_c5d00282d023807f02edac5d5751924a.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e20110>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_821e7552e535937fe2b68f7b30eb6fcf.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30259c90>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_119b5263e68d3e48344dc624386411f3.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_21acd3802302da74c5eaa4fe4db59e3e.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_a3f56652ce03956ad13712e040f06256.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_1ae764d77ec76c58b3fdfd79003bfee1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_b6f8adba1115835f4540ffc5ed81cf4b.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_80e60846f91d143b66b75364e70fdd03.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_9eacc099d891cc1154799ea0eae9d1b9.jpg not downloaded yet
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c8450>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_6e8ed8e98150fc59dd3d15f280d0703a.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167c10>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a6c4305d3d91d6254df986b9be4e1d15.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0db10>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_419659a6af768fd550b60c6fd10241a5.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f000ad0>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b1ebeb4662e458f796c06f4f3a8ddcfd.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_9c1fb21f8fa20ab27beb94a7115f26f3.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_c8f91661ad601f26bca29e93c911868e.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_05ff4a45231000d4aeb973b6f7066fa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_b9b5c3d3475e6d7faf7ffff88c9904eb.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_e7c10f14945f75b2a1caa965b8d75e36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_b110bfa29b0692b344b614c956b17fdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_fac62fa070cd64090f7adb8c66ea38b4.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_8270e245554553dc171893c800966a82.jpg not downloaded yet
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d34d0>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_a3f56652ce03956ad13712e040f06256.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30285590>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_1ae764d77ec76c58b3fdfd79003bfee1.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_d351a091406b4b824d5a40bcefceb440.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_2d24055cecd09d446a09284ca21c966b.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_a01949da1d5b7b2e9440246398a55c8a.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH71731> (referer: https://www.auto1.com/v1/car-details-view/CH71731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_f46d1fcc1054f42990501ce60eed1f7a.jpg not downloaded yet
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9d0d0>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_05ff4a45231000d4aeb973b6f7066fa0.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4c48b750>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_e7c10f14945f75b2a1caa965b8d75e36.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e63ad0>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_b110bfa29b0692b344b614c956b17fdc.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_60342c98576731ceb873e6215bf9b4ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_21acd3802302da74c5eaa4fe4db59e3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ef9a5c93d4752579a1a8d266487dac0a.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_7795cd88c6ffcd651ee140df88a92ceb.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_9eacc099d891cc1154799ea0eae9d1b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_9c1fb21f8fa20ab27beb94a7115f26f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_d18e86ca4b155e0d2283db0c988ed2f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_0234d5eab0e10b974dc783a4a66feec1.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH23682> (referer: https://www.auto1.com/v1/car-details-view/XH23682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_c8f91661ad601f26bca29e93c911868e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_02f9db9f94fbdee4977c337fb7ad119e.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_ed97fd62b806d021b0758cf2fb9cf9ca.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC11125> (referer: https://www.auto1.com/v1/car-details-view/JC11125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK16008> (referer: https://www.auto1.com/v1/car-details-view/FK16008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 926632fe-ce36-5a35-b411-8bff3fc401d9 with identifier: CH71731
2026-04-27 07:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926632fe-ce36-5a35-b411-8bff3fc401d9 with scrape type 1
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_b730b26a95f592bf3dcd0d9533ba8391.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ea42a9bf0b07dae1404ce07acbe5e405.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_2d3337f2ccbd97133fe6445817459e6c.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_aef3be09027f9b81026cfe7fb2518afa.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_4028c97d6765bd4ef5259b82773cffad.jpg not downloaded yet
2026-04-27 07:55:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4c476810>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_60342c98576731ceb873e6215bf9b4ab.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6a550>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_21acd3802302da74c5eaa4fe4db59e3e.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c390>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_9eacc099d891cc1154799ea0eae9d1b9.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c950>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_9c1fb21f8fa20ab27beb94a7115f26f3.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_5bb4360efdb1e1e942d4bb6cef60bf8c.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028f5d0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_d18e86ca4b155e0d2283db0c988ed2f0.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f969072e-1cef-55bf-ad17-03fce1b7fc36 with identifier: XH23682
2026-04-27 07:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f969072e-1cef-55bf-ad17-03fce1b7fc36 with scrape type 1
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bbfb1f6c6d7257dc15434703b2268602.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4cbd0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_c8f91661ad601f26bca29e93c911868e.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_2d24055cecd09d446a09284ca21c966b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_f46d1fcc1054f42990501ce60eed1f7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_a01949da1d5b7b2e9440246398a55c8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_fac62fa070cd64090f7adb8c66ea38b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_8270e245554553dc171893c800966a82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA09149> (referer: https://www.auto1.com/v1/car-details-view/FA09149/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_05f6c1fc223865f4e8526a3809466e4e.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_65dcaa13c08805180fd7e10d4cafb3d1.jpg not downloaded yet
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE47828> (referer: https://www.auto1.com/v1/car-details-view/RE47828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d2f8b23-3f47-556a-89e1-0d01349129b4 with identifier: JC11125
2026-04-27 07:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d2f8b23-3f47-556a-89e1-0d01349129b4 with scrape type 1
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2c4950e1b549185c00d8a03e47681d0d.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da478a69-9f2a-5b1e-b47e-30c811d3d674 with identifier: FK16008
2026-04-27 07:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da478a69-9f2a-5b1e-b47e-30c811d3d674 with scrape type 1
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_77a47938bd5b5f6f62e66fbfde2a3ff0.jpg not downloaded yet
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT24797> (referer: https://www.auto1.com/v1/car-details-view/RT24797/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_1f2e21fe22e20fdc7af2b3e68b7cc819.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_e70ce19e1e7572b43f992342992ef2c0.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_abfc8a4d33bf32213dcccf21e8ac6069.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_fc296fe8b0388ee26b9df3ff869d0681.jpg not downloaded yet
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_b730b26a95f592bf3dcd0d9533ba8391.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d050>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_2d24055cecd09d446a09284ca21c966b.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a34d0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_f46d1fcc1054f42990501ce60eed1f7a.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea8750>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_a01949da1d5b7b2e9440246398a55c8a.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a3010>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_fac62fa070cd64090f7adb8c66ea38b4.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60790>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_8270e245554553dc171893c800966a82.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a170c1ce-1958-537b-ad8b-32fc9854c87a with identifier: FA09149
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a170c1ce-1958-537b-ad8b-32fc9854c87a with scrape type 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_00b558f0b818621f84b48d5251358b9f.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_21c956d54a33dd4bf351d44332351774.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bb71381e6e92a73fdf17476d01e49166.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_638b5f0e8800a6874fc9c1e9e9739151.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_7005a8ef5f0f9a69230a3006d90399ac.jpg not downloaded yet
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ef9a5c93d4752579a1a8d266487dac0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_7795cd88c6ffcd651ee140df88a92ceb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_ed97fd62b806d021b0758cf2fb9cf9ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f3e5c8b12f457e58e042ba9f54a5881c.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895cb650-dc18-5efb-b2ad-615898d94148 with identifier: RE47828
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895cb650-dc18-5efb-b2ad-615898d94148 with scrape type 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_1267c50e48ddd4883826bebdee3b320e.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63c9669-ac52-5ab4-8014-3df03186acdc with identifier: RT24797
2026-04-27 07:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63c9669-ac52-5ab4-8014-3df03186acdc with scrape type 1
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_aca267d1be7269ecfd77a377577c4f1e.jpg not downloaded yet
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_4028c97d6765bd4ef5259b82773cffad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_c7d556e6f181c63ba6f7d33f34ad7591.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_88d95e4be4f1fe097a89c5c65c091a69.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4b938874c3f1563b8c6e3a7c48558c0a.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_bd4dc101a3c494f31a35ac329452688d.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_7ed3d1dd5b2aca4b8d47bb3199d317ac.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_b1ec63e871e3f340836f159d81787eed.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_777c17effc65ce1d156c0eef2a96dfed.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_57a576cf9d1d246d997f391afec3b4d9.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_06819e62fa04a1ad1c73576c6349993b.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2bb0e636b1eb0f28007c0f5e747cb536.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8a843791e3d15ad1ecd7c2f6ee70845c.jpg not downloaded yet
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d61710>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_b730b26a95f592bf3dcd0d9533ba8391.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_aef3be09027f9b81026cfe7fb2518afa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_02f9db9f94fbdee4977c337fb7ad119e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_14f82ba2b8ba4ecc92b3f16298c1da10.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_387c2f48b19ea51dce25209f91762a0f.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_fca5abba9eeef2bda6361cb62eaa048e.jpg not downloaded yet
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_4b898a440a6eb717cbe6c8cad5d35918.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_cebad0dae77556e8e3bb4a27dda34fea.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_27a4b1079a3650d72bec95b6885181d7.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7460f464c03ccabeed015428c4dce8ae.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9e040a6874d8137b7b05e25ca2798bb0.jpg not downloaded yet
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bf850>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ef9a5c93d4752579a1a8d266487dac0a.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc2f10>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_7795cd88c6ffcd651ee140df88a92ceb.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f42790>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_ed97fd62b806d021b0758cf2fb9cf9ca.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30061050>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_4028c97d6765bd4ef5259b82773cffad.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ea42a9bf0b07dae1404ce07acbe5e405.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_2d3337f2ccbd97133fe6445817459e6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bbfb1f6c6d7257dc15434703b2268602.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f53efb5e122afb1895973e65fea381ac.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_f6bff077761389d44c6f0708d13a15c7.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_b94c3fba5c920adc544cd4b6d1612c9f.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_d296ace0e2e7d5a25360583d8d8bfada.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7ebbb5b2241ae4ba6da5dd9f80369a71.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8c9ddecf18164c846b337e316fcaeb0c.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_fa021001d131b72bedc559b5ca430ec8.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_2b3ee298a863092a0a47f1388cfe8b9b.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_387fec1b77770f05920bc876ef132a26.jpg not downloaded yet
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d14d0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_aef3be09027f9b81026cfe7fb2518afa.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b647d0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_02f9db9f94fbdee4977c337fb7ad119e.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29a50>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_4b898a440a6eb717cbe6c8cad5d35918.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_5bb4360efdb1e1e942d4bb6cef60bf8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_2e910561600d55dd3bb744b4be506dc2.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_00a9bc06e2346abc611e4dcd8d386a46.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9ee7146414e38550f5d93ab523c4721f.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_89335cbb47c063e2106c3fcd2ec63e1e.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_249e819dfcb2b47898c2878b20938fb1.jpg not downloaded yet
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_baa43bc20247508d908097d19fb053da.jpg not downloaded yet
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcb4d0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ea42a9bf0b07dae1404ce07acbe5e405.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b79750>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_2d3337f2ccbd97133fe6445817459e6c.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d522d0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bbfb1f6c6d7257dc15434703b2268602.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_fc296fe8b0388ee26b9df3ff869d0681.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_00b558f0b818621f84b48d5251358b9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_abfc8a4d33bf32213dcccf21e8ac6069.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_5d43144d75af7bb7c17aa587bd956a26.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4f4f2fa1290ad0b12d3653912c2f9ff2.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_3506f458c97bdd980f0a8fe7afe454cd.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_aa9ebb90a22bddbb8226e67490e0d0c3.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_5cb3fdf0f384d5773a58119642462bc6.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_d2b5b3dec04f3d321094084eee653df6.jpg not downloaded yet
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_7005a8ef5f0f9a69230a3006d90399ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2a938d308d305984a3bd7191d44f693c.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9dbcfee79d3dcf93896eb8b6a1017af5.jpg not downloaded yet
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1fe10>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_5bb4360efdb1e1e942d4bb6cef60bf8c.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_77aa5d2d1354f739296e858b44b37f66.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_cdd6ae51236dee0b689dbd26a24218b3.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_e7a13f0868783b89b176dba000dac07b.jpg not downloaded yet
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2bb0e636b1eb0f28007c0f5e747cb536.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cd790>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_fc296fe8b0388ee26b9df3ff869d0681.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30300a90>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_00b558f0b818621f84b48d5251358b9f.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011c810>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_abfc8a4d33bf32213dcccf21e8ac6069.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_8840ddf6f57e817be8de82a17472680f.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_9c5b528d1fe7f92f9397f11b969b957e.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_6d2fe8ed60ab2e4c1e0e55d3ceafecc1.jpg not downloaded yet
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_fca5abba9eeef2bda6361cb62eaa048e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8a843791e3d15ad1ecd7c2f6ee70845c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_06819e62fa04a1ad1c73576c6349993b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_709e04af6ad44596a27de083415fa24e.jpg not downloaded yet
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_673b3e2324b9ced4560be8009958df20.jpg not downloaded yet
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc37d0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_7005a8ef5f0f9a69230a3006d90399ac.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b7b4d0>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2bb0e636b1eb0f28007c0f5e747cb536.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_387c2f48b19ea51dce25209f91762a0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU19955> (referer: https://www.auto1.com/v1/car-details-view/ZU19955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_0af0b11990ac44244afc17ad43b5eea8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f5a250>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_fca5abba9eeef2bda6361cb62eaa048e.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a150>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8a843791e3d15ad1ecd7c2f6ee70845c.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30131610>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_06819e62fa04a1ad1c73576c6349993b.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_d351a091406b4b824d5a40bcefceb440.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d50b50>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_387c2f48b19ea51dce25209f91762a0f.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c9cd79-edaf-591a-81f4-79649a426ad1 with identifier: ZU19955
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c9cd79-edaf-591a-81f4-79649a426ad1 with scrape type 1
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_e3b9cbbae34438afaeb0daccfdae863d.jpg not downloaded yet
2026-04-27 07:55:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b62190>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_0af0b11990ac44244afc17ad43b5eea8.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6acb802a-52aa-5874-b590-8bd8f3613f8f
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6acb802a-52aa-5874-b590-8bd8f3613f8f, skipping ID generation
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acb802a-52aa-5874-b590-8bd8f3613f8f with scrape type 1
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6acb802a-52aa-5874-b590-8bd8f3613f8f sending to next pipeline
2026-04-27 07:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6acb802a-52aa-5874-b590-8bd8f3613f8f, identifier: YR59159
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6acb802a-52aa-5874-b590-8bd8f3613f8f with identifier: YR59159
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6acb802a-52aa-5874-b590-8bd8f3613f8f with identifier: YR59159
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6acb802a-52aa-5874-b590-8bd8f3613f8f with identifier: YR59159 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_0af0b11990ac44244afc17ad43b5eea8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'city': 'Germersheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:48:45Z',
 'fuel_type': 'petrol',
 'id': '6acb802a-52aa-5874-b590-8bd8f3613f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR59159',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 173665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a6c4305d3d91d6254df986b9be4e1d15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_97820c132ba386983f079f2e39afed22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_419659a6af768fd550b60c6fd10241a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_821e7552e535937fe2b68f7b30eb6fcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3156631,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_4b898a440a6eb717cbe6c8cad5d35918.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_a56eece7453aaeb086fdcb7d78ffabb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_e5da6a5a565bf1065679270f4d5ec692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_08c9c8e9ff31f5134860f69fe7511475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3638839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_0af0b11990ac44244afc17ad43b5eea8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6acb802a-52aa-5874-b590-8bd8f3613f8f/6acb802a-52aa-5874-b590-8bd8f3613f8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/b2/b6b2bd431f2714fd8214a2845240aec7/pa/YR59159_2bff4d369bfea84ca9cf3663e3d1a222.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2014-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2014}
2026-04-27 07:55:05 [auto1.de] INFO: Saving data for YR59159: {'created_time': 1777276505.859432, 'last_price_update_time': 1777276505.859441, 'has_photos': True, 'auction_closing_time': 1777391325.0}
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_14f82ba2b8ba4ecc92b3f16298c1da10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_3e08dbb4377f79d385e4c3864180f11e.jpg not downloaded yet
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9ee7146414e38550f5d93ab523c4721f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_00a9bc06e2346abc611e4dcd8d386a46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8c9ddecf18164c846b337e316fcaeb0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_aab1ae0ec8ebfe6b551f2c4f4012817a.jpg not downloaded yet
2026-04-27 07:55:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f51790>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_d351a091406b4b824d5a40bcefceb440.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_fc8b289206f28875dbe124a16da62339.jpg not downloaded yet
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0bf10>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_14f82ba2b8ba4ecc92b3f16298c1da10.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30055650>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9ee7146414e38550f5d93ab523c4721f.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_45c5540ce3ff8170308a3932c97053ee.jpg not downloaded yet
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_9c5b528d1fe7f92f9397f11b969b957e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbce50>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_00a9bc06e2346abc611e4dcd8d386a46.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e23b10>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8c9ddecf18164c846b337e316fcaeb0c.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_6d2fe8ed60ab2e4c1e0e55d3ceafecc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9dbcfee79d3dcf93896eb8b6a1017af5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_8840ddf6f57e817be8de82a17472680f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_364169b2dbd30fd7ac9476e9aef953a9.jpg not downloaded yet
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_440503f43708175d2f3d61a9ccec6a0f.jpg not downloaded yet
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_74e30434fd6d616a2162f09a705283c5.jpg not downloaded yet
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2bed0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_9c5b528d1fe7f92f9397f11b969b957e.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_7a3e6c53839d02e583352c2150208752.jpg not downloaded yet
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_3e08dbb4377f79d385e4c3864180f11e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_658ac8db86657ac3352a1b281404c0b2.jpg not downloaded yet
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaf590>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_6d2fe8ed60ab2e4c1e0e55d3ceafecc1.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165810>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9dbcfee79d3dcf93896eb8b6a1017af5.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cae110>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_8840ddf6f57e817be8de82a17472680f.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2c4950e1b549185c00d8a03e47681d0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_709e04af6ad44596a27de083415fa24e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_e7a13f0868783b89b176dba000dac07b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_e3b9cbbae34438afaeb0daccfdae863d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_673b3e2324b9ced4560be8009958df20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b290>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_3e08dbb4377f79d385e4c3864180f11e.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_77a47938bd5b5f6f62e66fbfde2a3ff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_2e910561600d55dd3bb744b4be506dc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_3506f458c97bdd980f0a8fe7afe454cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_fc8b289206f28875dbe124a16da62339.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_45c5540ce3ff8170308a3932c97053ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fec210>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2c4950e1b549185c00d8a03e47681d0d.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_658ac8db86657ac3352a1b281404c0b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_7a3e6c53839d02e583352c2150208752.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb2710>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_709e04af6ad44596a27de083415fa24e.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b00990>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_e7a13f0868783b89b176dba000dac07b.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042ad0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_e3b9cbbae34438afaeb0daccfdae863d.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d683d0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_673b3e2324b9ced4560be8009958df20.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce22d0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_77a47938bd5b5f6f62e66fbfde2a3ff0.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b03290>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_2e910561600d55dd3bb744b4be506dc2.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d68390>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_3506f458c97bdd980f0a8fe7afe454cd.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_cdd6ae51236dee0b689dbd26a24218b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_d2b5b3dec04f3d321094084eee653df6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_440503f43708175d2f3d61a9ccec6a0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_77aa5d2d1354f739296e858b44b37f66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eab2150>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_fc8b289206f28875dbe124a16da62339.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cdad0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_45c5540ce3ff8170308a3932c97053ee.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2a938d308d305984a3bd7191d44f693c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d6c50>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_658ac8db86657ac3352a1b281404c0b2.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceead0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_7a3e6c53839d02e583352c2150208752.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67c10>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_cdd6ae51236dee0b689dbd26a24218b3.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30143410>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_d2b5b3dec04f3d321094084eee653df6.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c449d0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_440503f43708175d2f3d61a9ccec6a0f.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd0990>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_77aa5d2d1354f739296e858b44b37f66.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_364169b2dbd30fd7ac9476e9aef953a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_5cb3fdf0f384d5773a58119642462bc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_baa43bc20247508d908097d19fb053da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4f4f2fa1290ad0b12d3653912c2f9ff2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_5d43144d75af7bb7c17aa587bd956a26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67f50>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2a938d308d305984a3bd7191d44f693c.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_74e30434fd6d616a2162f09a705283c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_aab1ae0ec8ebfe6b551f2c4f4012817a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_aa9ebb90a22bddbb8226e67490e0d0c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_b94c3fba5c920adc544cd4b6d1612c9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4f910>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_364169b2dbd30fd7ac9476e9aef953a9.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ca1d0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_5cb3fdf0f384d5773a58119642462bc6.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300510d0>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_baa43bc20247508d908097d19fb053da.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3b10>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4f4f2fa1290ad0b12d3653912c2f9ff2.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301df290>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_5d43144d75af7bb7c17aa587bd956a26.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_387fec1b77770f05920bc876ef132a26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_249e819dfcb2b47898c2878b20938fb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_2b3ee298a863092a0a47f1388cfe8b9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_f6bff077761389d44c6f0708d13a15c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_fa021001d131b72bedc559b5ca430ec8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_d296ace0e2e7d5a25360583d8d8bfada.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb2f10>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_74e30434fd6d616a2162f09a705283c5.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30291210>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_aab1ae0ec8ebfe6b551f2c4f4012817a.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6c9cd79-edaf-591a-81f4-79649a426ad1
2026-04-27 07:55:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6c9cd79-edaf-591a-81f4-79649a426ad1, skipping ID generation
2026-04-27 07:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c9cd79-edaf-591a-81f4-79649a426ad1 with scrape type 1
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6c9cd79-edaf-591a-81f4-79649a426ad1 sending to next pipeline
2026-04-27 07:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6c9cd79-edaf-591a-81f4-79649a426ad1, identifier: ZU19955
2026-04-27 07:55:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ced010>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_aa9ebb90a22bddbb8226e67490e0d0c3.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c00790>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_b94c3fba5c920adc544cd4b6d1612c9f.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6c9cd79-edaf-591a-81f4-79649a426ad1 with identifier: ZU19955
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6c9cd79-edaf-591a-81f4-79649a426ad1 with identifier: ZU19955
2026-04-27 07:55:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6c9cd79-edaf-591a-81f4-79649a426ad1 with identifier: ZU19955 to the API
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_aab1ae0ec8ebfe6b551f2c4f4012817a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'city': 'Stuttgart',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 107,
 'expiration_date': '2026-04-28T15:05:46Z',
 'fuel_type': 'diesel',
 'id': 'b6c9cd79-edaf-591a-81f4-79649a426ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.7667,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU19955',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'location_confidence': 'geocoded',
 'longitude': 9.1833,
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 89557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_e3b9cbbae34438afaeb0daccfdae863d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_3e08dbb4377f79d385e4c3864180f11e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_aab1ae0ec8ebfe6b551f2c4f4012817a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_fc8b289206f28875dbe124a16da62339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_45c5540ce3ff8170308a3932c97053ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_364169b2dbd30fd7ac9476e9aef953a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_440503f43708175d2f3d61a9ccec6a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_74e30434fd6d616a2162f09a705283c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_7a3e6c53839d02e583352c2150208752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b6c9cd79-edaf-591a-81f4-79649a426ad1/b6c9cd79-edaf-591a-81f4-79649a426ad1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d44fa2f4897052927651bf4e519444/pa/ZU19955_658ac8db86657ac3352a1b281404c0b2.jpg',
             'Width': 800}],
 'postal_code': '70173',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Stuttgart',
 'province_code': 'DE-081',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2012-07-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2012}
2026-04-27 07:55:09 [auto1.de] INFO: Saving data for ZU19955: {'created_time': 1777276509.362178, 'last_price_update_time': 1777276509.362188, 'has_photos': True, 'auction_closing_time': 1777388746.0}
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f53efb5e122afb1895973e65fea381ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_cebad0dae77556e8e3bb4a27dda34fea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9e040a6874d8137b7b05e25ca2798bb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7460f464c03ccabeed015428c4dce8ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee6f90>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_387fec1b77770f05920bc876ef132a26.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ddc10>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_249e819dfcb2b47898c2878b20938fb1.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9550>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_2b3ee298a863092a0a47f1388cfe8b9b.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007b290>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_f6bff077761389d44c6f0708d13a15c7.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaf0d0>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_fa021001d131b72bedc559b5ca430ec8.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b87dd0>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_d296ace0e2e7d5a25360583d8d8bfada.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e08a50>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f53efb5e122afb1895973e65fea381ac.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015b550>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_cebad0dae77556e8e3bb4a27dda34fea.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05ed0>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9e040a6874d8137b7b05e25ca2798bb0.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30040e10>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7460f464c03ccabeed015428c4dce8ae.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_777c17effc65ce1d156c0eef2a96dfed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_b1ec63e871e3f340836f159d81787eed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_57a576cf9d1d246d997f391afec3b4d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_7ed3d1dd5b2aca4b8d47bb3199d317ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_bd4dc101a3c494f31a35ac329452688d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_89335cbb47c063e2106c3fcd2ec63e1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7ebbb5b2241ae4ba6da5dd9f80369a71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_27a4b1079a3650d72bec95b6885181d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_c7d556e6f181c63ba6f7d33f34ad7591.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_1267c50e48ddd4883826bebdee3b320e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_21c956d54a33dd4bf351d44332351774.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebbef10>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_777c17effc65ce1d156c0eef2a96dfed.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efbcd0>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_b1ec63e871e3f340836f159d81787eed.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4b938874c3f1563b8c6e3a7c48558c0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_1f2e21fe22e20fdc7af2b3e68b7cc819.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_aca267d1be7269ecfd77a377577c4f1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_88d95e4be4f1fe097a89c5c65c091a69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b659d0>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_57a576cf9d1d246d997f391afec3b4d9.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f78550>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_7ed3d1dd5b2aca4b8d47bb3199d317ac.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2190>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_bd4dc101a3c494f31a35ac329452688d.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da478a69-9f2a-5b1e-b47e-30c811d3d674
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da478a69-9f2a-5b1e-b47e-30c811d3d674, skipping ID generation
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da478a69-9f2a-5b1e-b47e-30c811d3d674 with scrape type 1
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da478a69-9f2a-5b1e-b47e-30c811d3d674 sending to next pipeline
2026-04-27 07:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da478a69-9f2a-5b1e-b47e-30c811d3d674, identifier: FK16008
2026-04-27 07:55:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ebdd0>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_89335cbb47c063e2106c3fcd2ec63e1e.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301eaa10>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7ebbb5b2241ae4ba6da5dd9f80369a71.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c03050>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_27a4b1079a3650d72bec95b6885181d7.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301e9810>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_c7d556e6f181c63ba6f7d33f34ad7591.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320999d0>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_1267c50e48ddd4883826bebdee3b320e.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 895cb650-dc18-5efb-b2ad-615898d94148
2026-04-27 07:55:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 895cb650-dc18-5efb-b2ad-615898d94148, skipping ID generation
2026-04-27 07:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895cb650-dc18-5efb-b2ad-615898d94148 with scrape type 1
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 895cb650-dc18-5efb-b2ad-615898d94148 sending to next pipeline
2026-04-27 07:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 895cb650-dc18-5efb-b2ad-615898d94148, identifier: RE47828
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65190>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_21c956d54a33dd4bf351d44332351774.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_638b5f0e8800a6874fc9c1e9e9739151.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da478a69-9f2a-5b1e-b47e-30c811d3d674 with identifier: FK16008
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da478a69-9f2a-5b1e-b47e-30c811d3d674 with identifier: FK16008
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da478a69-9f2a-5b1e-b47e-30c811d3d674 with identifier: FK16008 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_bd4dc101a3c494f31a35ac329452688d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Oranienburg',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:20:03Z',
 'fuel_type': 'petrol',
 'id': 'da478a69-9f2a-5b1e-b47e-30c811d3d674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.7558,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK16008',
 'listing': 'auction',
 'location': 'DE, Oranienburg',
 'location_confidence': 'geocoded',
 'longitude': 13.242,
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3071110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_77a47938bd5b5f6f62e66fbfde2a3ff0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_fc296fe8b0388ee26b9df3ff869d0681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_7005a8ef5f0f9a69230a3006d90399ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_bd4dc101a3c494f31a35ac329452688d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8a843791e3d15ad1ecd7c2f6ee70845c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9e040a6874d8137b7b05e25ca2798bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_8c9ddecf18164c846b337e316fcaeb0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9ee7146414e38550f5d93ab523c4721f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_3506f458c97bdd980f0a8fe7afe454cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da478a69-9f2a-5b1e-b47e-30c811d3d674/da478a69-9f2a-5b1e-b47e-30c811d3d674_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc23e9daf9bc83f021d486f127981fa7/pa/FK16008_9dbcfee79d3dcf93896eb8b6a1017af5.jpg',
             'Width': 800}],
 'postal_code': '16515',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2018-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-04-27 07:55:11 [auto1.de] INFO: Saving data for FK16008: {'created_time': 1777276511.395063, 'last_price_update_time': 1777276511.395075, 'has_photos': True, 'auction_closing_time': 1777389603.0}
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 895cb650-dc18-5efb-b2ad-615898d94148 with identifier: RE47828
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 895cb650-dc18-5efb-b2ad-615898d94148 with identifier: RE47828
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 895cb650-dc18-5efb-b2ad-615898d94148 with identifier: RE47828 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_1267c50e48ddd4883826bebdee3b320e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:26:26Z',
 'fuel_type': 'petrol',
 'id': '895cb650-dc18-5efb-b2ad-615898d94148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE47828',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 36373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_1267c50e48ddd4883826bebdee3b320e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_b1ec63e871e3f340836f159d81787eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_387c2f48b19ea51dce25209f91762a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_f6bff077761389d44c6f0708d13a15c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_2b3ee298a863092a0a47f1388cfe8b9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_249e819dfcb2b47898c2878b20938fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_5cb3fdf0f384d5773a58119642462bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_cdd6ae51236dee0b689dbd26a24218b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_9c5b528d1fe7f92f9397f11b969b957e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_895cb650-dc18-5efb-b2ad-615898d94148/895cb650-dc18-5efb-b2ad-615898d94148_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/b7/82b7d1368f72d6f87cb2705b01bad1ce/pa/RE47828_709e04af6ad44596a27de083415fa24e.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2017-05-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line RF',
 'transmission': 'manual',
 'trim': 'Sports-Line RF',
 'year': 2017}
2026-04-27 07:55:11 [auto1.de] INFO: Saving data for RE47828: {'created_time': 1777276511.755138, 'last_price_update_time': 1777276511.75515, 'has_photos': True, 'auction_closing_time': 1777389986.0}
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_b9b5c3d3475e6d7faf7ffff88c9904eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_05f6c1fc223865f4e8526a3809466e4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_e70ce19e1e7572b43f992342992ef2c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_65dcaa13c08805180fd7e10d4cafb3d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_0234d5eab0e10b974dc783a4a66feec1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b290>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4b938874c3f1563b8c6e3a7c48558c0a.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebb7c50>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_1f2e21fe22e20fdc7af2b3e68b7cc819.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4fdd0>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_aca267d1be7269ecfd77a377577c4f1e.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c63c9669-ac52-5ab4-8014-3df03186acdc
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c63c9669-ac52-5ab4-8014-3df03186acdc, skipping ID generation
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63c9669-ac52-5ab4-8014-3df03186acdc with scrape type 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c63c9669-ac52-5ab4-8014-3df03186acdc sending to next pipeline
2026-04-27 07:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c63c9669-ac52-5ab4-8014-3df03186acdc, identifier: RT24797
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c2790>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_88d95e4be4f1fe097a89c5c65c091a69.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffba90>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_638b5f0e8800a6874fc9c1e9e9739151.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d2f8b23-3f47-556a-89e1-0d01349129b4
2026-04-27 07:55:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d2f8b23-3f47-556a-89e1-0d01349129b4, skipping ID generation
2026-04-27 07:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d2f8b23-3f47-556a-89e1-0d01349129b4 with scrape type 1
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d2f8b23-3f47-556a-89e1-0d01349129b4 sending to next pipeline
2026-04-27 07:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d2f8b23-3f47-556a-89e1-0d01349129b4, identifier: JC11125
2026-04-27 07:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c63c9669-ac52-5ab4-8014-3df03186acdc with identifier: RT24797
2026-04-27 07:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c63c9669-ac52-5ab4-8014-3df03186acdc with identifier: RT24797
2026-04-27 07:55:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c63c9669-ac52-5ab4-8014-3df03186acdc with identifier: RT24797 to the API
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_aca267d1be7269ecfd77a377577c4f1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'city': 'Schkopau',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:02:29Z',
 'fuel_type': 'petrol',
 'id': 'c63c9669-ac52-5ab4-8014-3df03186acdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT24797',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 172137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_aca267d1be7269ecfd77a377577c4f1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_777c17effc65ce1d156c0eef2a96dfed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_fca5abba9eeef2bda6361cb62eaa048e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_b94c3fba5c920adc544cd4b6d1612c9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_387fec1b77770f05920bc876ef132a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_baa43bc20247508d908097d19fb053da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_d2b5b3dec04f3d321094084eee653df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_e7a13f0868783b89b176dba000dac07b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_6d2fe8ed60ab2e4c1e0e55d3ceafecc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c63c9669-ac52-5ab4-8014-3df03186acdc/c63c9669-ac52-5ab4-8014-3df03186acdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/91/f391d334f8d8b4b3ae6c0837e06881fc/pa/RT24797_673b3e2324b9ced4560be8009958df20.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2009-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Maxi Life Tramper',
 'transmission': 'manual',
 'trim': 'Maxi Life Tramper',
 'year': 2009}
2026-04-27 07:55:12 [auto1.de] INFO: Saving data for RT24797: {'created_time': 1777276512.781368, 'last_price_update_time': 1777276512.781381, 'has_photos': True, 'auction_closing_time': 1777388549.0}
2026-04-27 07:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d2f8b23-3f47-556a-89e1-0d01349129b4 with identifier: JC11125
2026-04-27 07:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d2f8b23-3f47-556a-89e1-0d01349129b4 with identifier: JC11125
2026-04-27 07:55:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d2f8b23-3f47-556a-89e1-0d01349129b4 with identifier: JC11125 to the API
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_638b5f0e8800a6874fc9c1e9e9739151.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'city': 'Seddiner See',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:15:09Z',
 'fuel_type': 'diesel',
 'id': '0d2f8b23-3f47-556a-89e1-0d01349129b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC11125',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 86146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2c4950e1b549185c00d8a03e47681d0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_abfc8a4d33bf32213dcccf21e8ac6069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_638b5f0e8800a6874fc9c1e9e9739151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4b938874c3f1563b8c6e3a7c48558c0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2bb0e636b1eb0f28007c0f5e747cb536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7460f464c03ccabeed015428c4dce8ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_7ebbb5b2241ae4ba6da5dd9f80369a71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_00a9bc06e2346abc611e4dcd8d386a46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_4f4f2fa1290ad0b12d3653912c2f9ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d2f8b23-3f47-556a-89e1-0d01349129b4/0d2f8b23-3f47-556a-89e1-0d01349129b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/9f/799fab7efc45c29e889622e1e5c74f17/pa/JC11125_2a938d308d305984a3bd7191d44f693c.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2020-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2020}
2026-04-27 07:55:13 [auto1.de] INFO: Saving data for JC11125: {'created_time': 1777276513.16392, 'last_price_update_time': 1777276513.16393, 'has_photos': True, 'auction_closing_time': 1777389309.0}
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bb71381e6e92a73fdf17476d01e49166.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_0d689a383eb20c05d66cbce19ac94652.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b878d0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_b9b5c3d3475e6d7faf7ffff88c9904eb.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f50510>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_05f6c1fc223865f4e8526a3809466e4e.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 926632fe-ce36-5a35-b411-8bff3fc401d9
2026-04-27 07:55:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 926632fe-ce36-5a35-b411-8bff3fc401d9, skipping ID generation
2026-04-27 07:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926632fe-ce36-5a35-b411-8bff3fc401d9 with scrape type 1
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 926632fe-ce36-5a35-b411-8bff3fc401d9 sending to next pipeline
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 926632fe-ce36-5a35-b411-8bff3fc401d9, identifier: CH71731
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f64490>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_e70ce19e1e7572b43f992342992ef2c0.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b10410>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_65dcaa13c08805180fd7e10d4cafb3d1.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301582d0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_0234d5eab0e10b974dc783a4a66feec1.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_d008f128bfa8989e1a9bf5e82f2a26ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_429c33b34232e2db536d72cccf1f3393.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_24667af7e1bbb7ef377986df0e4951d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_80e60846f91d143b66b75364e70fdd03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_b6f8adba1115835f4540ffc5ed81cf4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 926632fe-ce36-5a35-b411-8bff3fc401d9 with identifier: CH71731
2026-04-27 07:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 926632fe-ce36-5a35-b411-8bff3fc401d9 with identifier: CH71731
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 926632fe-ce36-5a35-b411-8bff3fc401d9 with identifier: CH71731 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_05f6c1fc223865f4e8526a3809466e4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': 'Rental',
 'city': 'Gütersloh',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-04-28T15:49:35Z',
 'fuel_type': 'petrol',
 'id': '926632fe-ce36-5a35-b411-8bff3fc401d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.9,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH71731',
 'listing': 'auction',
 'location': 'DE, Gütersloh',
 'location_confidence': 'geocoded',
 'longitude': 8.384,
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 77287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_b730b26a95f592bf3dcd0d9533ba8391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_aef3be09027f9b81026cfe7fb2518afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_4028c97d6765bd4ef5259b82773cffad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_5bb4360efdb1e1e942d4bb6cef60bf8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_05f6c1fc223865f4e8526a3809466e4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_1f2e21fe22e20fdc7af2b3e68b7cc819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_21c956d54a33dd4bf351d44332351774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_c7d556e6f181c63ba6f7d33f34ad7591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_57a576cf9d1d246d997f391afec3b4d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_926632fe-ce36-5a35-b411-8bff3fc401d9/926632fe-ce36-5a35-b411-8bff3fc401d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/b8/7fb8ced4a6492fc9a92e635fe7ee56fe/pa/CH71731_cebad0dae77556e8e3bb4a27dda34fea.jpg',
             'Width': 800}],
 'postal_code': '33311',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Detmold',
 'province_code': 'DE-057',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2023-02-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Audi Q7 55 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-04-27 07:55:14 [auto1.de] INFO: Saving data for CH71731: {'created_time': 1777276514.085179, 'last_price_update_time': 1777276514.085235, 'has_photos': True, 'auction_closing_time': 1777391375.0}
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_0c8b5033d4c27dc5fe0f59d9352661da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_a9842b28a87b76b11f529cc99922d5ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_1fa1e9e9f650903309fb0b63bb71b9c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b12750>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bb71381e6e92a73fdf17476d01e49166.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f969072e-1cef-55bf-ad17-03fce1b7fc36
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f969072e-1cef-55bf-ad17-03fce1b7fc36, skipping ID generation
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f969072e-1cef-55bf-ad17-03fce1b7fc36 with scrape type 1
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f969072e-1cef-55bf-ad17-03fce1b7fc36 sending to next pipeline
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f969072e-1cef-55bf-ad17-03fce1b7fc36, identifier: XH23682
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8afd0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_0d689a383eb20c05d66cbce19ac94652.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fed390>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_d008f128bfa8989e1a9bf5e82f2a26ba.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0950>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_429c33b34232e2db536d72cccf1f3393.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceafd0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_24667af7e1bbb7ef377986df0e4951d5.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ec8cd0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_80e60846f91d143b66b75364e70fdd03.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea510>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_b6f8adba1115835f4540ffc5ed81cf4b.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_7998dcc66474fbb97eb9689f19175916.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f969072e-1cef-55bf-ad17-03fce1b7fc36 with identifier: XH23682
2026-04-27 07:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f969072e-1cef-55bf-ad17-03fce1b7fc36 with identifier: XH23682
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f969072e-1cef-55bf-ad17-03fce1b7fc36 with identifier: XH23682 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bb71381e6e92a73fdf17476d01e49166.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': 'Rental',
 'city': 'Darmstadt',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:24:55Z',
 'fuel_type': 'petrol',
 'id': 'f969072e-1cef-55bf-ad17-03fce1b7fc36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.8719,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH23682',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'location_confidence': 'geocoded',
 'longitude': 8.6484,
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 75155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bbfb1f6c6d7257dc15434703b2268602.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_65dcaa13c08805180fd7e10d4cafb3d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_e70ce19e1e7572b43f992342992ef2c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_bb71381e6e92a73fdf17476d01e49166.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_88d95e4be4f1fe097a89c5c65c091a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_06819e62fa04a1ad1c73576c6349993b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_27a4b1079a3650d72bec95b6885181d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_d296ace0e2e7d5a25360583d8d8bfada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_2e910561600d55dd3bb744b4be506dc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f969072e-1cef-55bf-ad17-03fce1b7fc36/f969072e-1cef-55bf-ad17-03fce1b7fc36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/f2/8ef251e6fe774be2441fd9b4cb3d080c/pa/XH23682_5d43144d75af7bb7c17aa587bd956a26.jpg',
             'Width': 800}],
 'postal_code': '64283',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2019-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 4WD',
 'transmission': 'manual',
 'trim': 'Trend 4WD',
 'year': 2019}
2026-04-27 07:55:15 [auto1.de] INFO: Saving data for XH23682: {'created_time': 1777276515.339401, 'last_price_update_time': 1777276515.339414, 'has_photos': True, 'auction_closing_time': 1777389895.0}
2026-04-27 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_f53c27ebe087c73d495f451f83f767d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_35e2ebf4de73519731a729008a5a2301.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_db9eeea7fa620687fdf192d26c780038.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee5ed0>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_0c8b5033d4c27dc5fe0f59d9352661da.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0
2026-04-27 07:55:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3c4fc4f-fdcf-50ad-830d-09525006cbb0, skipping ID generation
2026-04-27 07:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with scrape type 1
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3c4fc4f-fdcf-50ad-830d-09525006cbb0 sending to next pipeline
2026-04-27 07:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3c4fc4f-fdcf-50ad-830d-09525006cbb0, identifier: JW55153
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29850>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_a9842b28a87b76b11f529cc99922d5ff.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7574b9c9-efe4-5514-bbae-16d2f6621c86
2026-04-27 07:55:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7574b9c9-efe4-5514-bbae-16d2f6621c86, skipping ID generation
2026-04-27 07:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7574b9c9-efe4-5514-bbae-16d2f6621c86 with scrape type 1
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7574b9c9-efe4-5514-bbae-16d2f6621c86 sending to next pipeline
2026-04-27 07:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7574b9c9-efe4-5514-bbae-16d2f6621c86, identifier: XX62478
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300afd50>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_1fa1e9e9f650903309fb0b63bb71b9c9.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0e90>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_7998dcc66474fbb97eb9689f19175916.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with identifier: JW55153
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with identifier: JW55153
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3c4fc4f-fdcf-50ad-830d-09525006cbb0 with identifier: JW55153 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_0c8b5033d4c27dc5fe0f59d9352661da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Kerpen',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 195,
 'expiration_date': '2026-04-28T15:59:37Z',
 'fuel_type': 'diesel',
 'id': 'f3c4fc4f-fdcf-50ad-830d-09525006cbb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW55153',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 184157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_0c8b5033d4c27dc5fe0f59d9352661da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_b110bfa29b0692b344b614c956b17fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_d18e86ca4b155e0d2283db0c988ed2f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_80e60846f91d143b66b75364e70fdd03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_c8f91661ad601f26bca29e93c911868e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_8270e245554553dc171893c800966a82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_a01949da1d5b7b2e9440246398a55c8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_7795cd88c6ffcd651ee140df88a92ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_ed97fd62b806d021b0758cf2fb9cf9ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3c4fc4f-fdcf-50ad-830d-09525006cbb0/f3c4fc4f-fdcf-50ad-830d-09525006cbb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/dd/31dd3a859afad8e5d47e8f8c935d315b/pa/JW55153_2d3337f2ccbd97133fe6445817459e6c.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2013-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Biturbo Innovation 4x4',
 'transmission': 'manual',
 'trim': 'Innovation 4x4',
 'year': 2013}
2026-04-27 07:55:16 [auto1.de] INFO: Saving data for JW55153: {'created_time': 1777276516.185546, 'last_price_update_time': 1777276516.18556, 'has_photos': True, 'auction_closing_time': 1777391977.0}
2026-04-27 07:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7574b9c9-efe4-5514-bbae-16d2f6621c86 with identifier: XX62478
2026-04-27 07:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7574b9c9-efe4-5514-bbae-16d2f6621c86 with identifier: XX62478
2026-04-27 07:55:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7574b9c9-efe4-5514-bbae-16d2f6621c86 with identifier: XX62478 to the API
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_a9842b28a87b76b11f529cc99922d5ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Berlin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:53:26Z',
 'fuel_type': 'diesel',
 'id': '7574b9c9-efe4-5514-bbae-16d2f6621c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.5323,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX62478',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'location_confidence': 'geocoded',
 'longitude': 13.3846,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 270664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_a9842b28a87b76b11f529cc99922d5ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_05ff4a45231000d4aeb973b6f7066fa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_d008f128bfa8989e1a9bf5e82f2a26ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_b6f8adba1115835f4540ffc5ed81cf4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_9c1fb21f8fa20ab27beb94a7115f26f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_fac62fa070cd64090f7adb8c66ea38b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_2d24055cecd09d446a09284ca21c966b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ef9a5c93d4752579a1a8d266487dac0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_02f9db9f94fbdee4977c337fb7ad119e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7574b9c9-efe4-5514-bbae-16d2f6621c86/7574b9c9-efe4-5514-bbae-16d2f6621c86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4b/194b0c86ae1486908e80f5aa673d8dd7/pa/XX62478_ea42a9bf0b07dae1404ce07acbe5e405.jpg',
             'Width': 800}],
 'postal_code': '10115',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Berlin',
 'region_code': 'DE-BE',
 'registration_date': '2013-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2013}
2026-04-27 07:55:16 [auto1.de] INFO: Saving data for XX62478: {'created_time': 1777276516.971891, 'last_price_update_time': 1777276516.971903, 'has_photos': True, 'auction_closing_time': 1777391606.0}
2026-04-27 07:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_2a0fb9ca8b355b45ca15657f4e3abdce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_edfa01128ca23a8a1105def64bef719c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_fd1d2c649d941135709f6ad458dcfdcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_641bce76040e1075b6a8e4578fb41cf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300acd90>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_f53c27ebe087c73d495f451f83f767d0.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e927264e-ea42-529f-9afb-b47ee3cd5567
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e927264e-ea42-529f-9afb-b47ee3cd5567, skipping ID generation
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e927264e-ea42-529f-9afb-b47ee3cd5567 with scrape type 1
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e927264e-ea42-529f-9afb-b47ee3cd5567 sending to next pipeline
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e927264e-ea42-529f-9afb-b47ee3cd5567, identifier: CG92624
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e07950>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_35e2ebf4de73519731a729008a5a2301.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ced010>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_db9eeea7fa620687fdf192d26c780038.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e927264e-ea42-529f-9afb-b47ee3cd5567 with identifier: CG92624
2026-04-27 07:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e927264e-ea42-529f-9afb-b47ee3cd5567 with identifier: CG92624
2026-04-27 07:55:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e927264e-ea42-529f-9afb-b47ee3cd5567 with identifier: CG92624 to the API
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_f53c27ebe087c73d495f451f83f767d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Kandel',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:25:25Z',
 'fuel_type': 'petrol',
 'id': 'e927264e-ea42-529f-9afb-b47ee3cd5567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG92624',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 24660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_5b34e9875cab81809b05c510691aa341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_119b5263e68d3e48344dc624386411f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_ef669ba07bda8c678f7c70507c713970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_c5d00282d023807f02edac5d5751924a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_6e8ed8e98150fc59dd3d15f280d0703a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_1ae764d77ec76c58b3fdfd79003bfee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_f53c27ebe087c73d495f451f83f767d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_7998dcc66474fbb97eb9689f19175916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_24667af7e1bbb7ef377986df0e4951d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e927264e-ea42-529f-9afb-b47ee3cd5567/e927264e-ea42-529f-9afb-b47ee3cd5567_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/80/098003e2ad3989b16225f979428a0463/pa/CG92624_0d689a383eb20c05d66cbce19ac94652.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-04-27 07:55:18 [auto1.de] INFO: Saving data for CG92624: {'created_time': 1777276518.514933, 'last_price_update_time': 1777276518.514945, 'has_photos': True, 'auction_closing_time': 1777389925.0}
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_0863c15a94483bc176737650457ccdb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df0d50>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_2a0fb9ca8b355b45ca15657f4e3abdce.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb2d90>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_edfa01128ca23a8a1105def64bef719c.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcb7d0>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_fd1d2c649d941135709f6ad458dcfdcc.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30097d50>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_641bce76040e1075b6a8e4578fb41cf6.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3
2026-04-27 07:55:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38a030bf-6cad-5dd3-a5f5-c73c521840c3, skipping ID generation
2026-04-27 07:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with scrape type 1
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38a030bf-6cad-5dd3-a5f5-c73c521840c3 sending to next pipeline
2026-04-27 07:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38a030bf-6cad-5dd3-a5f5-c73c521840c3, identifier: DA35415
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_97d83f8d360767fa47e6723eb9c9c2fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with identifier: DA35415
2026-04-27 07:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with identifier: DA35415
2026-04-27 07:55:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38a030bf-6cad-5dd3-a5f5-c73c521840c3 with identifier: DA35415 to the API
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_641bce76040e1075b6a8e4578fb41cf6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Germersheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:06:59Z',
 'fuel_type': 'diesel',
 'id': '38a030bf-6cad-5dd3-a5f5-c73c521840c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA35415',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 211314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_00903f840db3efb1c3eda93247639ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_0083224f361a6eca81f027b88cf5eaf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_641bce76040e1075b6a8e4578fb41cf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_2a0fb9ca8b355b45ca15657f4e3abdce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_d13e7b1a01b8bd674040792fc63a4bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b75d015466e4aaccb3620e71fb5e8c9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_1fa1e9e9f650903309fb0b63bb71b9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_9886a8906fad7924e38ebd66e27902d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_b1ebeb4662e458f796c06f4f3a8ddcfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38a030bf-6cad-5dd3-a5f5-c73c521840c3/38a030bf-6cad-5dd3-a5f5-c73c521840c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c471f021df7a48751b09a872ffa1f3/pa/DA35415_78543303736a04ad3a71a55c5cd0926e.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2014-09-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-04-27 07:55:19 [auto1.de] INFO: Saving data for DA35415: {'created_time': 1777276519.447382, 'last_price_update_time': 1777276519.447394, 'has_photos': True, 'auction_closing_time': 1777388819.0}
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_e3420c5254c9501c28f756faa599ad56.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ29416> (referer: https://www.auto1.com/v1/car-details-view/XJ29416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX32615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC69895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ68842> (referer: https://www.auto1.com/v1/car-details-view/SZ68842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2cf90>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_0863c15a94483bc176737650457ccdb8.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB78369> (referer: https://www.auto1.com/v1/car-details-view/CB78369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d7d90>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_97d83f8d360767fa47e6723eb9c9c2fc.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT65753> (referer: https://www.auto1.com/v1/car-details-view/PT65753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011e290>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_e3420c5254c9501c28f756faa599ad56.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f3e5c8b12f457e58e042ba9f54a5881c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_34b1151d00a71dd5dfc34ac647b03edb.png> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a59e0bb76efc57aad815ffe6d11ae3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb29f87a-a0d2-54cd-916c-da11451327a8 with identifier: XJ29416
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb29f87a-a0d2-54cd-916c-da11451327a8 with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cb29f87a-a0d2-54cd-916c-da11451327a8
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_2bf109445950b7e014e66932b8fcc534.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_c3a9f307fc98ecc6da70624ea3186615.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67bf1e9-e54f-5e74-9433-c2c4b3b833ef with identifier: SZ68842
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67bf1e9-e54f-5e74-9433-c2c4b3b833ef with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a67bf1e9-e54f-5e74-9433-c2c4b3b833ef
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_c9c2fcd2232ec47f4195b586ff611bdc.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce428b3-1fb3-557a-8198-f3dbcf05b941 with identifier: CB78369
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce428b3-1fb3-557a-8198-f3dbcf05b941 with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9ce428b3-1fb3-557a-8198-f3dbcf05b941
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_75a8202d68112c80c8f2005357798c2c.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_d6dbcc63e93f54e5986e106d52e474ba.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_981886f5080669067ddc130a6e6359f7.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_5823edf228217106f9a957207a276932.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_84fa90abf5caf1da7d42130e4f1d96df.jpg not downloaded yet
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447c5e63-b65d-5195-98d4-e1652264536e with identifier: PT65753
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447c5e63-b65d-5195-98d4-e1652264536e with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_62fd59522800021ef76563d8b4f0a347.jpg not downloaded yet
2026-04-27 07:55:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301eb750>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f3e5c8b12f457e58e042ba9f54a5881c.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a170c1ce-1958-537b-ad8b-32fc9854c87a
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a170c1ce-1958-537b-ad8b-32fc9854c87a, skipping ID generation
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a170c1ce-1958-537b-ad8b-32fc9854c87a with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a170c1ce-1958-537b-ad8b-32fc9854c87a sending to next pipeline
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a170c1ce-1958-537b-ad8b-32fc9854c87a, identifier: FA09149
2026-04-27 07:55:20 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:55:20 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:55:20 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b73950>
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_1.png HTTP/1.1" 201 0
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_34b1151d00a71dd5dfc34ac647b03edb.png saved to cache
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb
2026-04-27 07:55:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb, skipping ID generation
2026-04-27 07:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with scrape type 1
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82892c11-5b9a-5a2f-9b0a-3314277b2ecb sending to next pipeline
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb, identifier: WS85819
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_4114607f6b57767bf53df8b72d95dc78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_1f77d910bfecc1969e964aad116886c9.jpg not downloaded yet
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_cc5bfb7bdf16999b0521634f65141af2.jpg not downloaded yet
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a170c1ce-1958-537b-ad8b-32fc9854c87a with identifier: FA09149
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a170c1ce-1958-537b-ad8b-32fc9854c87a with identifier: FA09149
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a170c1ce-1958-537b-ad8b-32fc9854c87a with identifier: FA09149 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f3e5c8b12f457e58e042ba9f54a5881c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Bremen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:35:35Z',
 'fuel_type': 'petrol',
 'id': 'a170c1ce-1958-537b-ad8b-32fc9854c87a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.0889,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA09149',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'location_confidence': 'geocoded',
 'longitude': 8.7906,
 'make': 'Toyota',
 'model': 'Corolla Verso',
 'odometer': 176280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_00b558f0b818621f84b48d5251358b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f3e5c8b12f457e58e042ba9f54a5881c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_7ed3d1dd5b2aca4b8d47bb3199d317ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_14f82ba2b8ba4ecc92b3f16298c1da10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_f53efb5e122afb1895973e65fea381ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_fa021001d131b72bedc559b5ca430ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1839413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_89335cbb47c063e2106c3fcd2ec63e1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_aa9ebb90a22bddbb8226e67490e0d0c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_77aa5d2d1354f739296e858b44b37f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a170c1ce-1958-537b-ad8b-32fc9854c87a/a170c1ce-1958-537b-ad8b-32fc9854c87a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/c9/88c9d7be4b6f971cef42b510b384e25d/pa/FA09149_8840ddf6f57e817be8de82a17472680f.jpg',
             'Width': 800}],
 'postal_code': '28195',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Bremen',
 'region_code': 'DE-HB',
 'registration_date': '2008-09-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Toyota Corolla Verso 1.8 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2008}
2026-04-27 07:55:20 [auto1.de] INFO: Saving data for FA09149: {'created_time': 1777276520.627889, 'last_price_update_time': 1777276520.6279, 'has_photos': True, 'auction_closing_time': 1777390535.0}
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with identifier: WS85819
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with identifier: WS85819
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82892c11-5b9a-5a2f-9b0a-3314277b2ecb with identifier: WS85819 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_34b1151d00a71dd5dfc34ac647b03edb.png>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:33:05Z',
 'fuel_type': 'diesel',
 'id': '82892c11-5b9a-5a2f-9b0a-3314277b2ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS85819',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 318333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 871877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_63c5e808cd8d766a787a3a7b1af55f2a.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 884469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_34b1151d00a71dd5dfc34ac647b03edb.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_0863c15a94483bc176737650457ccdb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82892c11-5b9a-5a2f-9b0a-3314277b2ecb/82892c11-5b9a-5a2f-9b0a-3314277b2ecb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d5/6ad59f65c67b0c8a0f552d3d2bd6d3a6/pa/WS85819_edfa01128ca23a8a1105def64bef719c.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2024-02-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 317 CDI Kasten L3 / L4',
 'transmission': 'automatic',
 'trim': 'Kasten L3 / L4',
 'year': 2024}
2026-04-27 07:55:20 [auto1.de] INFO: Saving data for WS85819: {'created_time': 1777276520.992179, 'last_price_update_time': 1777276520.992189, 'has_photos': True, 'auction_closing_time': 1777390385.0}
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_574c3141bb8031ff9a76ebb6a9480b43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_708b2924fbadb10c74b7c1321a450cfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_2bf109445950b7e014e66932b8fcc534.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_3360df4755e77b90be9fb1f0c427b0ee.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_9a00477e79f7808b0c17c9ef4e7b6d80.jpg not downloaded yet
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6b890>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a59e0bb76efc57aad815ffe6d11ae3e.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 259fc57b-96b6-5846-bd89-37bf5c203bb4
2026-04-27 07:55:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 259fc57b-96b6-5846-bd89-37bf5c203bb4, skipping ID generation
2026-04-27 07:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 259fc57b-96b6-5846-bd89-37bf5c203bb4 with scrape type 1
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 259fc57b-96b6-5846-bd89-37bf5c203bb4 sending to next pipeline
2026-04-27 07:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 259fc57b-96b6-5846-bd89-37bf5c203bb4, identifier: CC68415
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_954a5f569b66db7560eaed23c8e4d3e6.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_83251f1f13b8411eb5641fe0a45d9c45.jpg not downloaded yet
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF68308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB86127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 259fc57b-96b6-5846-bd89-37bf5c203bb4 with identifier: CC68415
2026-04-27 07:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 259fc57b-96b6-5846-bd89-37bf5c203bb4 with identifier: CC68415
2026-04-27 07:55:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 259fc57b-96b6-5846-bd89-37bf5c203bb4 with identifier: CC68415 to the API
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a59e0bb76efc57aad815ffe6d11ae3e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'city': 'Laatzen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-04-28T15:02:22Z',
 'fuel_type': 'petrol',
 'id': '259fc57b-96b6-5846-bd89-37bf5c203bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3151,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC68415',
 'listing': 'auction',
 'location': 'Laatzen',
 'location_confidence': 'geocoded',
 'longitude': 9.7974,
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 143954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_db59eafe8ce2d42e0bf23643d3505d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_391318d68162c1e73d5528a57181f404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_10b3bc56d180eebec6afac1fb2437bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a59e0bb76efc57aad815ffe6d11ae3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_e3420c5254c9501c28f756faa599ad56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_97d83f8d360767fa47e6723eb9c9c2fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_ab70747f717be1ead0b5ff70f1ec1093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_1a870e1616649c867b9f8a80b6ec6560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_9b862d31971c072e14427476240b4936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_259fc57b-96b6-5846-bd89-37bf5c203bb4/259fc57b-96b6-5846-bd89-37bf5c203bb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/f0/c4f0d4aa011ef9c53776a0fe5ba413ac/pa/CC68415_af4476363706311e2ac99ba68b40200c.jpg',
             'Width': 800}],
 'postal_code': '30880',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2017-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i40 2.0 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-04-27 07:55:21 [auto1.de] INFO: Saving data for CC68415: {'created_time': 1777276521.638764, 'last_price_update_time': 1777276521.638776, 'has_photos': True, 'auction_closing_time': 1777388542.0}
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_0b710ae7990ab94e67195e482dcac35b.jpg not downloaded yet
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6bd50>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_4114607f6b57767bf53df8b72d95dc78.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_68b0cfc3e055ed15a58ec4e5a5031a65.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_725167d2972fede1cd82d43df799fbde.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_706cb454d05addf7e1b1c189f8481e90.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_ab0cf8ff8969f19d5bda2c5dd38696ff.jpg not downloaded yet
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_525a1f2ae67f9f01544225d4f06d3297.jpg not downloaded yet
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH70761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH76413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d68850>
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_574c3141bb8031ff9a76ebb6a9480b43.jpg saved to cache
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7298fb42-3757-5f25-b5a4-1ab525683bd0
2026-04-27 07:55:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7298fb42-3757-5f25-b5a4-1ab525683bd0, skipping ID generation
2026-04-27 07:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7298fb42-3757-5f25-b5a4-1ab525683bd0 with scrape type 1
2026-04-27 07:55:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7298fb42-3757-5f25-b5a4-1ab525683bd0 sending to next pipeline
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7298fb42-3757-5f25-b5a4-1ab525683bd0, identifier: VT80082
2026-04-27 07:55:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c30d50>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_708b2924fbadb10c74b7c1321a450cfe.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8ef064f-8ab2-5278-ab38-db3961e127cf
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8ef064f-8ab2-5278-ab38-db3961e127cf, skipping ID generation
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ef064f-8ab2-5278-ab38-db3961e127cf with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8ef064f-8ab2-5278-ab38-db3961e127cf sending to next pipeline
2026-04-27 07:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8ef064f-8ab2-5278-ab38-db3961e127cf, identifier: FE20387
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b88310>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb29f87a-a0d2-54cd-916c-da11451327a8/cb29f87a-a0d2-54cd-916c-da11451327a8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_2bf109445950b7e014e66932b8fcc534.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb29f87a-a0d2-54cd-916c-da11451327a8
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b28fbdb0c644b01b6511e584565462f3.jpg not downloaded yet
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7298fb42-3757-5f25-b5a4-1ab525683bd0 with identifier: VT80082
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7298fb42-3757-5f25-b5a4-1ab525683bd0 with identifier: VT80082
2026-04-27 07:55:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7298fb42-3757-5f25-b5a4-1ab525683bd0 with identifier: VT80082 to the API
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_574c3141bb8031ff9a76ebb6a9480b43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Kiel',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-04-28T15:31:54Z',
 'fuel_type': 'diesel',
 'id': '7298fb42-3757-5f25-b5a4-1ab525683bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3205,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT80082',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'location_confidence': 'geocoded',
 'longitude': 10.1327,
 'make': 'BMW',
 'model': '5er',
 'odometer': 189739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_fd1d2c649d941135709f6ad458dcfdcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_35e2ebf4de73519731a729008a5a2301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_db9eeea7fa620687fdf192d26c780038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2021632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_4114607f6b57767bf53df8b72d95dc78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247338,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_574c3141bb8031ff9a76ebb6a9480b43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7c3a3f23d4d3b4ea700f93c4797359c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_7a5f8f2fddce840293d3b03f0339a592.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_e5a35df28fdc46badf94e1fbbde07580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_60342c98576731ceb873e6215bf9b4ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7298fb42-3757-5f25-b5a4-1ab525683bd0/7298fb42-3757-5f25-b5a4-1ab525683bd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2235024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/9c/f79cf9783ee87d950809586a5a2ea2ca/pa/VT80082_d9849dee5a49afd0e7e2aa41f81471ba.jpg',
             'Width': 2048}],
 'postal_code': '24103',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2013-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-04-27 07:55:22 [auto1.de] INFO: Saving data for VT80082: {'created_time': 1777276522.657504, 'last_price_update_time': 1777276522.657514, 'has_photos': True, 'auction_closing_time': 1777390314.0}
2026-04-27 07:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8ef064f-8ab2-5278-ab38-db3961e127cf with identifier: FE20387
2026-04-27 07:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8ef064f-8ab2-5278-ab38-db3961e127cf with identifier: FE20387
2026-04-27 07:55:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8ef064f-8ab2-5278-ab38-db3961e127cf with identifier: FE20387 to the API
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_708b2924fbadb10c74b7c1321a450cfe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:42:57Z',
 'fuel_type': 'petrol',
 'id': 'e8ef064f-8ab2-5278-ab38-db3961e127cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE20387',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 128094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_a3f56652ce03956ad13712e040f06256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_708b2924fbadb10c74b7c1321a450cfe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_e7c10f14945f75b2a1caa965b8d75e36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_429c33b34232e2db536d72cccf1f3393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_21acd3802302da74c5eaa4fe4db59e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_9eacc099d891cc1154799ea0eae9d1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_b9b5c3d3475e6d7faf7ffff88c9904eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_d351a091406b4b824d5a40bcefceb440.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_f46d1fcc1054f42990501ce60eed1f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8ef064f-8ab2-5278-ab38-db3961e127cf/e8ef064f-8ab2-5278-ab38-db3961e127cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/44/694435cf1d2a53bc67f505a65d8bff45/pa/FE20387_0234d5eab0e10b974dc783a4a66feec1.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2019-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-04-27 07:55:23 [auto1.de] INFO: Saving data for FE20387: {'created_time': 1777276523.065954, 'last_price_update_time': 1777276523.065963, 'has_photos': True, 'auction_closing_time': 1777390977.0}
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_c89c5b32d7c24e6af2a9aeb13293936a.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD67147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_ee7017dff20a2d6836ecbb6b74c8cc63.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL21385> (referer: https://www.auto1.com/v1/car-details-view/GL21385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_b49c8754a54af91e6ea17f69e2746da9.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_3841e56e8025c47be662de461ed20cb1.jpg not downloaded yet
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_6577085574dd842b752c35c77e2b059a.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_96c9c8627d57399b015aab1c110322ad.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_df914f8a9a3225ef039ae178b77cc6f3.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_725167d2972fede1cd82d43df799fbde.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b7fcdf5a106093f29147e7ba2ce0f423.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_83251f1f13b8411eb5641fe0a45d9c45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_be8acacb83c44e632da38aab7dcdc153.jpg not downloaded yet
2026-04-27 07:55:23 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 10555 | hits on page: 40
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6124bc-92a3-5dea-bfd1-03bdbe297970 with identifier: GL21385
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970 with scrape type 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_4b6711e99f62a0239f22e98c7e4e4be1.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_706cb454d05addf7e1b1c189f8481e90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG72708> (referer: https://www.auto1.com/v1/car-details-view/AG72708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [auto1.de] INFO: Found listing with ID: WW29948
2026-04-27 07:55:23 [auto1.de] INFO: Scrape type for WW29948: 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_113708ca0c7292d54210daf2aa0dff1d.jpg not downloaded yet
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_0b710ae7990ab94e67195e482dcac35b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_68b0cfc3e055ed15a58ec4e5a5031a65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_3360df4755e77b90be9fb1f0c427b0ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [auto1.de] INFO: Found listing with ID: TT24076
2026-04-27 07:55:23 [auto1.de] INFO: Scrape type for TT24076: 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_9dc9b83799cd112bb933e8a54b615024.jpg not downloaded yet
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [auto1.de] INFO: Found listing with ID: KR31319
2026-04-27 07:55:23 [auto1.de] INFO: Scrape type for KR31319: 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_275db3f6d363196bc5f8b7cb1647c3f0.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159550>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ce428b3-1fb3-557a-8198-f3dbcf05b941/9ce428b3-1fb3-557a-8198-f3dbcf05b941_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_725167d2972fede1cd82d43df799fbde.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ce428b3-1fb3-557a-8198-f3dbcf05b941
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028cb10>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ce428b3-1fb3-557a-8198-f3dbcf05b941/9ce428b3-1fb3-557a-8198-f3dbcf05b941_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/c8/bbc861780594c46406c3ef73b6144db1/pa/CB78369_83251f1f13b8411eb5641fe0a45d9c45.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ce428b3-1fb3-557a-8198-f3dbcf05b941
2026-04-27 07:55:23 [auto1.de] INFO: Found listing with ID: DB61488
2026-04-27 07:55:23 [auto1.de] INFO: Scrape type for DB61488: 2
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21ac2fcc-3318-53f7-abff-d1e503f265ac with identifier: DB61488
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21ac2fcc-3318-53f7-abff-d1e503f265ac with scrape type 2
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21ac2fcc-3318-53f7-abff-d1e503f265ac with scrape type 2
2026-04-27 07:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21ac2fcc-3318-53f7-abff-d1e503f265ac, identifier: DB61488
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_97d9c12451464557a6d67a63eb5958ab.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_4b6711e99f62a0239f22e98c7e4e4be1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21ac2fcc-3318-53f7-abff-d1e503f265ac with identifier: DB61488
2026-04-27 07:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21ac2fcc-3318-53f7-abff-d1e503f265ac with identifier: DB61488
2026-04-27 07:55:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21ac2fcc-3318-53f7-abff-d1e503f265ac with identifier: DB61488 to the API
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-04-28T15:29:42Z',
 'fuel_type': 'diesel',
 'id': '21ac2fcc-3318-53f7-abff-d1e503f265ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB61488',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 260230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-04-27 07:55:24 [auto1.de] INFO: Saving data for DB61488: {'auction_closing_time': 1777390182.0, 'created_time': 1776952247.494757, 'has_photos': True, 'last_price_update_time': 1777276524.912192}
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8e890>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_706cb454d05addf7e1b1c189f8481e90.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2726f05b-cbbd-59fc-90c5-fe71dd7664d5 with identifier: AG72708
2026-04-27 07:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5 with scrape type 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_ff42f4180328af3938fda512204bd4e1.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_113708ca0c7292d54210daf2aa0dff1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: ZV11848
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for ZV11848: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_e3cf91d876850f39c22f7961af4fa47d.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b7fcdf5a106093f29147e7ba2ce0f423.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_36b421806617bff192fde6da792b855b.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH71338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ86660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK83419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA73737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e89d0>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_0b710ae7990ab94e67195e482dcac35b.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b52790>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67bf1e9-e54f-5e74-9433-c2c4b3b833ef/a67bf1e9-e54f-5e74-9433-c2c4b3b833ef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_68b0cfc3e055ed15a58ec4e5a5031a65.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a67bf1e9-e54f-5e74-9433-c2c4b3b833ef
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a9190>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb29f87a-a0d2-54cd-916c-da11451327a8/cb29f87a-a0d2-54cd-916c-da11451327a8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f489743dd0d607342799a4e3b4d6c11/pa/XJ29416_3360df4755e77b90be9fb1f0c427b0ee.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb29f87a-a0d2-54cd-916c-da11451327a8
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: ZR83037
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for ZR83037: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_8555b02a0d033571b888abe1887a2f9a.jpg not downloaded yet
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c0290>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_4b6711e99f62a0239f22e98c7e4e4be1.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_275db3f6d363196bc5f8b7cb1647c3f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_5382daee4372040668d9e3fab496b023.jpg not downloaded yet
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: FL74349
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for FL74349: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_c47f8a5feaec1678fdfd2ec8746072b1.jpg not downloaded yet
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40f50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_113708ca0c7292d54210daf2aa0dff1d.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b834d0>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b7fcdf5a106093f29147e7ba2ce0f423.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_ff42f4180328af3938fda512204bd4e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7fdba3fc32194d410c0a617d94a74cd4.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_97d9c12451464557a6d67a63eb5958ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: TE49682
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for TE49682: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_b3aedbaa1aaa041befb3f65b07de692f.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_9dc9b83799cd112bb933e8a54b615024.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_ef11c7ab63ab1c78eb5ab5d6e7edf5f5.jpg not downloaded yet
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3029a010>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_275db3f6d363196bc5f8b7cb1647c3f0.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_e3cf91d876850f39c22f7961af4fa47d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_36b421806617bff192fde6da792b855b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: PG03778
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for PG03778: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_25fc1d3b93dce3adbe117f0b8f777147.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_9eb32568bbe1d02a92964133d23617b9.jpg not downloaded yet
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: EX14210
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for EX14210: 1
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30301c50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_ff42f4180328af3938fda512204bd4e1.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_5382daee4372040668d9e3fab496b023.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_adfd03127b1f7e59c9ac00ecc3854c14.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7fdba3fc32194d410c0a617d94a74cd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: KC87070
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for KC87070: 1
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecdb50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_97d9c12451464557a6d67a63eb5958ab.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b89b50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_9dc9b83799cd112bb933e8a54b615024.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7244aab89e661291297079e9870cf16c.jpg not downloaded yet
2026-04-27 07:55:25 [auto1.de] INFO: Found listing with ID: KS93678
2026-04-27 07:55:25 [auto1.de] INFO: Scrape type for KS93678: 1
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_b3aedbaa1aaa041befb3f65b07de692f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_a96e18e676729ba8662b43534d7c8ca5.jpg not downloaded yet
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65290>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_e3cf91d876850f39c22f7961af4fa47d.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cde10>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_36b421806617bff192fde6da792b855b.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cde10>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_5382daee4372040668d9e3fab496b023.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018a5d0>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7fdba3fc32194d410c0a617d94a74cd4.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: GP77208
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for GP77208: 1
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_9eb32568bbe1d02a92964133d23617b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_b35e72e8af7fa54a2924d95a79ae0130.jpg not downloaded yet
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: VD40103
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for VD40103: 1
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH76413> (referer: https://www.auto1.com/v1/car-details-view/PH76413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH70761> (referer: https://www.auto1.com/v1/car-details-view/CH70761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW29948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dce010>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a6124bc-92a3-5dea-bfd1-03bdbe297970/2a6124bc-92a3-5dea-bfd1-03bdbe297970_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/dd/fcdd5d9d38ee3456e17a504ab07e26cb/pa/GL21385_b3aedbaa1aaa041befb3f65b07de692f.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a6124bc-92a3-5dea-bfd1-03bdbe297970
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7244aab89e661291297079e9870cf16c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: VA67645
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for VA67645: 1
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_954a5f569b66db7560eaed23c8e4d3e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: ND23678
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for ND23678: 1
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b70b10>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_9eb32568bbe1d02a92964133d23617b9.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_a96e18e676729ba8662b43534d7c8ca5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: VU61436
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for VU61436: 1
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_b35e72e8af7fa54a2924d95a79ae0130.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_9a00477e79f7808b0c17c9ef4e7b6d80.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: EY48619
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for EY48619: 1
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb1bb63-2e88-523a-8950-82280b18c2a7 with identifier: PH76413
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb1bb63-2e88-523a-8950-82280b18c2a7 with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_26dc45e3862e363b6d66943b7f5fbe49.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with identifier: CH70761
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_836d98ec7f60331823c1494716b9f52c.jpg not downloaded yet
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: GG61471
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for GG61471: 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_c488988618238414105e0bb41fea5447.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a351cc905de14145cb3db835face753.jpg not downloaded yet
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165b90>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_7244aab89e661291297079e9870cf16c.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_adfd03127b1f7e59c9ac00ecc3854c14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: SA43432
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for SA43432: 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_a113366c9beca725e69d504ba244ad5f.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_30c0f2b211173ff32c6becfa420a14e9.jpg not downloaded yet
2026-04-27 07:55:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3450>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a67bf1e9-e54f-5e74-9433-c2c4b3b833ef/a67bf1e9-e54f-5e74-9433-c2c4b3b833ef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a2/85a2d76e350ec65e66fc6c81919bc7a7/pa/SZ68842_954a5f569b66db7560eaed23c8e4d3e6.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a67bf1e9-e54f-5e74-9433-c2c4b3b833ef
2026-04-27 07:55:26 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 10555 | hits on page: 40
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca1190>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_a96e18e676729ba8662b43534d7c8ca5.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b28fbdb0c644b01b6511e584565462f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: EW29882
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for EW29882: 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_0c17d02b1992b9e3815a19e2a74829d0.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_ec30d8eecca5789f74f4263fbc41b921.jpg not downloaded yet
2026-04-27 07:55:26 [auto1.de] INFO: Found listing with ID: KZ07980
2026-04-27 07:55:26 [auto1.de] INFO: Scrape type for KZ07980: 1
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c85490>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_b35e72e8af7fa54a2924d95a79ae0130.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dad790>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_9a00477e79f7808b0c17c9ef4e7b6d80.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bfd90>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2726f05b-cbbd-59fc-90c5-fe71dd7664d5/2726f05b-cbbd-59fc-90c5-fe71dd7664d5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa8b7feb6b38e36ef4997eecb922f6/pa/AG72708_adfd03127b1f7e59c9ac00ecc3854c14.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2726f05b-cbbd-59fc-90c5-fe71dd7664d5
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: JW86353
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for JW86353: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_79edbdc9d47a88f8f332cdc04a2fe0e9.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_96f1b5b874429eb0571636e7c30e4677.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: SJ72213
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for SJ72213: 1
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_96c9c8627d57399b015aab1c110322ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: YL95157
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for YL95157: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_33bba400ec88c8b1252ecb4a4b078cbe.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_6cb2ab5f6d4c1fd578e4b4c260fb7124.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: CG22932
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for CG22932: 1
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV11848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1f4d0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_b28fbdb0c644b01b6511e584565462f3.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA73737> (referer: https://www.auto1.com/v1/car-details-view/EA73737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: LR46282
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for LR46282: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_3e878d90f6913e0a561845b473618c30.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_2c4750d1005a8091ed8f748182f938f3.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: VJ30423
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for VJ30423: 1
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD67147> (referer: https://www.auto1.com/v1/car-details-view/WD67147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: JD36657
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for JD36657: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_999d1c3901b561d4e9899e363c26dbca.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_3eab97c4b659de058285abd99f1d10dc.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: NB89914
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for NB89914: 1
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30132f10>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447c5e63-b65d-5195-98d4-e1652264536e/447c5e63-b65d-5195-98d4-e1652264536e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/90/0690eda0b3e9dd3f25cabd38838dd068/pa/PT65753_96c9c8627d57399b015aab1c110322ad.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 447c5e63-b65d-5195-98d4-e1652264536e
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: CD92686
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for CD92686: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_b3c4453d28fd159bd28b6647c89e7d28.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a24d0936e3c50665f856155e8e75e04.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: SK60822
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for SK60822: 1
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS93678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: HU32806
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for HU32806: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_822762849bf84856f421a1c0bf8f63a5.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_845f1b15456a6cda7112b991d22d3d4d.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: CY47782
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for CY47782: 1
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdca542-996e-58b3-bffc-bdcdb88c92be with identifier: EA73737
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdca542-996e-58b3-bffc-bdcdb88c92be with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_6d93b1b9b6210137a3953269426323a1.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf290ab-e4dc-5140-8f2e-91204bf66d82 with identifier: WD67147
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf290ab-e4dc-5140-8f2e-91204bf66d82 with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_661c9ccca33a59240116faa4c90896f2.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: PY08500
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for PY08500: 1
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: CE31107
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for CE31107: 1
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_96f1b5b874429eb0571636e7c30e4677.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_8b5b4a2f816e94b365756292538d6324.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ede697a3974e353db943454367c4384b.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX14210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_6cb2ab5f6d4c1fd578e4b4c260fb7124.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: DV82025
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for DV82025: 1
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: RV10859
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for RV10859: 1
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_cc636daf1b0e778f86e8b220c71a6199.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ece344a0dddbac28e61bdea7bf006d29.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: MX61933
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for MX61933: 1
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: KJ44904
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for KJ44904: 1
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE49682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_49a45cc323599702cdab39e7c4d57877.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_cc4fafb67dd8ff6b6608ff992d0d3cd5.jpg not downloaded yet
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: HK45490
2026-04-27 07:55:27 [auto1.de] INFO: Scrape type for HK45490: 1
2026-04-27 07:55:27 [auto1.de] INFO: Found listing with ID: PA23243
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for PA23243: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_9cd193a2b888772441bae156275b9835.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_9b408de4b423d27c2c920e3edf366e6c.jpg not downloaded yet
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0a390>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_96f1b5b874429eb0571636e7c30e4677.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcd950>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_6cb2ab5f6d4c1fd578e4b4c260fb7124.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: YY61240
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for YY61240: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: AG26382
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for AG26382: 1
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_661c9ccca33a59240116faa4c90896f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_aee087496443adb864d8f9c831d5139c.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_a479825d1970ef1b1573bee79de1a246.jpg not downloaded yet
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: YK55062
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for YK55062: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: DG81101
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for DG81101: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_878ea48a3fd96d1fb9582c82afaa6e30.jpg not downloaded yet
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: WY44353
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for WY44353: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: DA32853
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for DA32853: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_1af0c2947154ff9afa03eb45a5ab52d4.jpg not downloaded yet
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: FB76592
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for FB76592: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: UV45704
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for UV45704: 1
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efbb50>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_661c9ccca33a59240116faa4c90896f2.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_0444cb6b2b2c3ced32470aa21005a925.jpg not downloaded yet
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: GN42898
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for GN42898: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: HT17957
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for HT17957: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_c597f8e6b129779b6bbdb68760bb01f3.jpg not downloaded yet
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA67645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: GL15578
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for GL15578: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: NF59010
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for NF59010: 1
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC87070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP77208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: HS17247
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for HS17247: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: ZT78140
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for ZT78140: 1
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD40103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: BP15031
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for BP15031: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: KD88399
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for KD88399: 1
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: TK11851
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for TK11851: 1
2026-04-27 07:55:28 [auto1.de] INFO: Found listing with ID: GV24790
2026-04-27 07:55:28 [auto1.de] INFO: Scrape type for GV24790: 2
2026-04-27 07:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-04-27 07:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-04-27 07:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e646652c-9b01-55dd-b97c-99c0ed9f989f, identifier: GV24790
2026-04-27 07:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-04-27 07:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-04-27 07:55:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790 to the API
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-04-28T15:19:27Z',
 'fuel_type': 'petrol',
 'id': 'e646652c-9b01-55dd-b97c-99c0ed9f989f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV24790',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Audi',
 'model': 'TT',
 'odometer': 80845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2010-11-01',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2010}
2026-04-27 07:55:29 [auto1.de] INFO: Saving data for GV24790: {'auction_closing_time': 1777389567.0, 'created_time': 1772541820.992114, 'last_price_update_time': 1777276529.743523, 'has_photos': False}
2026-04-27 07:55:29 [auto1.de] INFO: Found listing with ID: PE32946
2026-04-27 07:55:29 [auto1.de] INFO: Scrape type for PE32946: 1
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG22932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND23678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL95157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [auto1.de] INFO: Found listing with ID: CN60683
2026-04-27 07:55:29 [auto1.de] INFO: Scrape type for CN60683: 1
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [auto1.de] INFO: Found listing with ID: YJ27680
2026-04-27 07:55:29 [auto1.de] INFO: Scrape type for YJ27680: 1
2026-04-27 07:55:29 [auto1.de] INFO: Found listing with ID: SE18089
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for SE18089: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: JA25017
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for JA25017: 1
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_33bba400ec88c8b1252ecb4a4b078cbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: JM47084
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for JM47084: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: WJ84209
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for WJ84209: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: AR78319
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for AR78319: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: KV10415
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for KV10415: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: WR24520
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for WR24520: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: MM42561
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for MM42561: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: FH83727
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for FH83727: 1
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0b650>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_33bba400ec88c8b1252ecb4a4b078cbe.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: VN99537
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for VN99537: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: CR73975
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for CR73975: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: ZH89181
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for ZH89181: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: VV80524
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for VV80524: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: BP83751
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for BP83751: 1
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: ZR44160
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for ZR44160: 1
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ30423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: SG66334
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for SG66334: 1
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [auto1.de] INFO: Found listing with ID: CY90259
2026-04-27 07:55:30 [auto1.de] INFO: Scrape type for CY90259: 1
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE31107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ72213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV11848> (referer: https://www.auto1.com/v1/car-details-view/ZV11848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24062828-0c9d-5e35-8522-7058120e77c2 with identifier: ZV11848
2026-04-27 07:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24062828-0c9d-5e35-8522-7058120e77c2 with scrape type 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_7a1f89793e1164860c7c8c1ef201c063.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_a8ae3cc727c11d2658c5554289f26d81.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_234770ad21b444144fbdc65ee6d5d847.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_738cc5027e4e26eb24232668d7c50651.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_6d06f6fe8cce396eaedd7cfd7947d0da.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_f288cab30d38b390a646e5e6579debd1.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8b65101543878b8562cdfd9c22737c93.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8f5078ca3c792af368e71b5ca3b6d4bd.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_ce9f8fd250cb324c4ebba3ed1be0597f.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_53afdbc451cb0f0c3cc307aa1144779d.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS93678> (referer: https://www.auto1.com/v1/car-details-view/KS93678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY08500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with identifier: KS93678
2026-04-27 07:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with scrape type 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f8812c0d84cb908fe732bf73d792b3a7.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_bc289e087669ef46d2c9bf1f05ad682d.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_84347d52d9221755bb07a18573c4326b.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5be68441bc398811de0b6d07faca9e0.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5754693f0f2cbf71bc9fc9f23ad9e63.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG26382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_ab9d82111692a55a796c06db12906570.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_53afdbc451cb0f0c3cc307aa1144779d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_a8eee4e173c4e2a9ad927fb3674d1b5a.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f6d990268905c544798a14448ed68763.jpg not downloaded yet
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_243565d2722dd90f0561cb18fea8fffa.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL15578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_193589865823b6d01b86f54065354530.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_ce9f8fd250cb324c4ebba3ed1be0597f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_ab9d82111692a55a796c06db12906570.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62c10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_53afdbc451cb0f0c3cc307aa1144779d.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f6d990268905c544798a14448ed68763.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e95c190>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_ce9f8fd250cb324c4ebba3ed1be0597f.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecccd0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_ab9d82111692a55a796c06db12906570.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5754693f0f2cbf71bc9fc9f23ad9e63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_193589865823b6d01b86f54065354530.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f37d90>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f6d990268905c544798a14448ed68763.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_243565d2722dd90f0561cb18fea8fffa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_a8eee4e173c4e2a9ad927fb3674d1b5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b62f50>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5754693f0f2cbf71bc9fc9f23ad9e63.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30279890>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_193589865823b6d01b86f54065354530.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29e10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_243565d2722dd90f0561cb18fea8fffa.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a2750>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_a8eee4e173c4e2a9ad927fb3674d1b5a.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5be68441bc398811de0b6d07faca9e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca0fd0>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5be68441bc398811de0b6d07faca9e0.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_84347d52d9221755bb07a18573c4326b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC87070> (referer: https://www.auto1.com/v1/car-details-view/KC87070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_bc289e087669ef46d2c9bf1f05ad682d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE32946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f8812c0d84cb908fe732bf73d792b3a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b61990>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_84347d52d9221755bb07a18573c4326b.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8f5078ca3c792af368e71b5ca3b6d4bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA25017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46263081-329f-5ff9-8879-2d249836e5c6 with identifier: KC87070
2026-04-27 07:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46263081-329f-5ff9-8879-2d249836e5c6 with scrape type 1
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_18369fba82785ab91bb27b989032c508.jpg not downloaded yet
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2b410>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_bc289e087669ef46d2c9bf1f05ad682d.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8b65101543878b8562cdfd9c22737c93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_a928b875d889671e6ebb50742f9488fe.jpg not downloaded yet
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa4d50>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f8812c0d84cb908fe732bf73d792b3a7.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90
2026-04-27 07:55:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90, skipping ID generation
2026-04-27 07:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with scrape type 1
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 sending to next pipeline
2026-04-27 07:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90, identifier: KS93678
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_d1707f8b18b8b4ff9c2a708483b3d9a4.jpg not downloaded yet
2026-04-27 07:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with identifier: KS93678
2026-04-27 07:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with identifier: KS93678
2026-04-27 07:55:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b8abbb3-8f28-50a6-bb6b-6620c3bcca90 with identifier: KS93678 to the API
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f8812c0d84cb908fe732bf73d792b3a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.0L',
 'engine_horse_power': 475,
 'expiration_date': '2026-04-28T15:43:13Z',
 'fuel_type': 'petrol',
 'id': '1b8abbb3-8f28-50a6-bb6b-6620c3bcca90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS93678',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 66452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f8812c0d84cb908fe732bf73d792b3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_bc289e087669ef46d2c9bf1f05ad682d.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_84347d52d9221755bb07a18573c4326b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5be68441bc398811de0b6d07faca9e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_b5754693f0f2cbf71bc9fc9f23ad9e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_ab9d82111692a55a796c06db12906570.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_a8eee4e173c4e2a9ad927fb3674d1b5a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_f6d990268905c544798a14448ed68763.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_243565d2722dd90f0561cb18fea8fffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1b8abbb3-8f28-50a6-bb6b-6620c3bcca90/1b8abbb3-8f28-50a6-bb6b-6620c3bcca90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/f1/18f13faa0a68f947c53385cd123759ea/pa/KS93678_193589865823b6d01b86f54065354530.jpg',
             'Width': 450}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2016}
2026-04-27 07:55:33 [auto1.de] INFO: Saving data for KS93678: {'created_time': 1777276533.436481, 'last_price_update_time': 1777276533.436492, 'has_photos': True, 'auction_closing_time': 1777390993.0}
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_738cc5027e4e26eb24232668d7c50651.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_f288cab30d38b390a646e5e6579debd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_6d06f6fe8cce396eaedd7cfd7947d0da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_180ea712b039840bacfb8f744147d1a5.jpg not downloaded yet
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT17957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8890>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8f5078ca3c792af368e71b5ca3b6d4bd.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe86d0>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8b65101543878b8562cdfd9c22737c93.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT78140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_ddda7e94e7c0bb8c8a7935e9a4c8395a.jpg not downloaded yet
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_18369fba82785ab91bb27b989032c508.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca1fd0>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_738cc5027e4e26eb24232668d7c50651.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289650>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_f288cab30d38b390a646e5e6579debd1.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30194a10>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_6d06f6fe8cce396eaedd7cfd7947d0da.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b232bdba9141c3c69f5922b5075da6f9.jpg not downloaded yet
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_d1707f8b18b8b4ff9c2a708483b3d9a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_979c64fc6a8a53a76fefdc06cd0a35bd.jpg not downloaded yet
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30133d10>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_18369fba82785ab91bb27b989032c508.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_234770ad21b444144fbdc65ee6d5d847.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b795abacf5c7311ddf3d4e34aeed683a.jpg not downloaded yet
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_a928b875d889671e6ebb50742f9488fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_80ae7ec7a8f4b5b5419246c8c869a3a1.jpg not downloaded yet
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_9ff7d0be03f3b0dee9c12aa6f7c62fa2.jpg not downloaded yet
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dac590>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_d1707f8b18b8b4ff9c2a708483b3d9a4.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_ddda7e94e7c0bb8c8a7935e9a4c8395a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30197b90>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_234770ad21b444144fbdc65ee6d5d847.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_180ea712b039840bacfb8f744147d1a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_9ff7d0be03f3b0dee9c12aa6f7c62fa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3010>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_a928b875d889671e6ebb50742f9488fe.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_979c64fc6a8a53a76fefdc06cd0a35bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015b590>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_ddda7e94e7c0bb8c8a7935e9a4c8395a.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b795abacf5c7311ddf3d4e34aeed683a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d526d0>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_180ea712b039840bacfb8f744147d1a5.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cfa50>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_9ff7d0be03f3b0dee9c12aa6f7c62fa2.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dcb50>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_979c64fc6a8a53a76fefdc06cd0a35bd.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b232bdba9141c3c69f5922b5075da6f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_80ae7ec7a8f4b5b5419246c8c869a3a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY90259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007b490>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b795abacf5c7311ddf3d4e34aeed683a.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_7a1f89793e1164860c7c8c1ef201c063.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22caf7d0>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b232bdba9141c3c69f5922b5075da6f9.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fed810>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_80ae7ec7a8f4b5b5419246c8c869a3a1.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46263081-329f-5ff9-8879-2d249836e5c6
2026-04-27 07:55:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46263081-329f-5ff9-8879-2d249836e5c6, skipping ID generation
2026-04-27 07:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46263081-329f-5ff9-8879-2d249836e5c6 with scrape type 1
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46263081-329f-5ff9-8879-2d249836e5c6 sending to next pipeline
2026-04-27 07:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46263081-329f-5ff9-8879-2d249836e5c6, identifier: KC87070
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_a8ae3cc727c11d2658c5554289f26d81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46263081-329f-5ff9-8879-2d249836e5c6 with identifier: KC87070
2026-04-27 07:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46263081-329f-5ff9-8879-2d249836e5c6 with identifier: KC87070
2026-04-27 07:55:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46263081-329f-5ff9-8879-2d249836e5c6 with identifier: KC87070 to the API
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_80ae7ec7a8f4b5b5419246c8c869a3a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'city': 'Germersheim',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:55:10Z',
 'fuel_type': 'petrol',
 'id': '46263081-329f-5ff9-8879-2d249836e5c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC87070',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 73972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_18369fba82785ab91bb27b989032c508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_a928b875d889671e6ebb50742f9488fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_d1707f8b18b8b4ff9c2a708483b3d9a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_180ea712b039840bacfb8f744147d1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_ddda7e94e7c0bb8c8a7935e9a4c8395a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b232bdba9141c3c69f5922b5075da6f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_979c64fc6a8a53a76fefdc06cd0a35bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_b795abacf5c7311ddf3d4e34aeed683a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_80ae7ec7a8f4b5b5419246c8c869a3a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_46263081-329f-5ff9-8879-2d249836e5c6/46263081-329f-5ff9-8879-2d249836e5c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/90/d890c8b0c230ebffa5aa1e1ccde90982/pa/KC87070_9ff7d0be03f3b0dee9c12aa6f7c62fa2.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2009-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-04-27 07:55:35 [auto1.de] INFO: Saving data for KC87070: {'created_time': 1777276535.088828, 'last_price_update_time': 1777276535.088856, 'has_photos': True, 'auction_closing_time': 1777391710.0}
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR44160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF59010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1850>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_7a1f89793e1164860c7c8c1ef201c063.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG26382> (referer: https://www.auto1.com/v1/car-details-view/AG26382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ72213> (referer: https://www.auto1.com/v1/car-details-view/SJ72213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c13a10>
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_a8ae3cc727c11d2658c5554289f26d81.jpg saved to cache
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24062828-0c9d-5e35-8522-7058120e77c2
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24062828-0c9d-5e35-8522-7058120e77c2, skipping ID generation
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24062828-0c9d-5e35-8522-7058120e77c2 with scrape type 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24062828-0c9d-5e35-8522-7058120e77c2 sending to next pipeline
2026-04-27 07:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24062828-0c9d-5e35-8522-7058120e77c2, identifier: ZV11848
2026-04-27 07:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24062828-0c9d-5e35-8522-7058120e77c2 with identifier: ZV11848
2026-04-27 07:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24062828-0c9d-5e35-8522-7058120e77c2 with identifier: ZV11848
2026-04-27 07:55:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24062828-0c9d-5e35-8522-7058120e77c2 with identifier: ZV11848 to the API
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_a8ae3cc727c11d2658c5554289f26d81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-04-28T15:58:13Z',
 'fuel_type': 'diesel',
 'id': '24062828-0c9d-5e35-8522-7058120e77c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11848',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 102397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_7a1f89793e1164860c7c8c1ef201c063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_a8ae3cc727c11d2658c5554289f26d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_234770ad21b444144fbdc65ee6d5d847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_738cc5027e4e26eb24232668d7c50651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_6d06f6fe8cce396eaedd7cfd7947d0da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_f288cab30d38b390a646e5e6579debd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8b65101543878b8562cdfd9c22737c93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_8f5078ca3c792af368e71b5ca3b6d4bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_ce9f8fd250cb324c4ebba3ed1be0597f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24062828-0c9d-5e35-8522-7058120e77c2/24062828-0c9d-5e35-8522-7058120e77c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/2e/212e0877d2693f10489366548d2000f2/pa/ZV11848_53afdbc451cb0f0c3cc307aa1144779d.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 45 TDI quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2020}
2026-04-27 07:55:35 [auto1.de] INFO: Saving data for ZV11848: {'created_time': 1777276535.650837, 'last_price_update_time': 1777276535.65085, 'has_photos': True, 'auction_closing_time': 1777391893.0}
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5f67de-4917-5a80-90d5-38cb58253c1e with identifier: AG26382
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5f67de-4917-5a80-90d5-38cb58253c1e with scrape type 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_664fa818036fd9c227b83da4af62310f.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a9966a8-c356-5255-a653-a0d5be117057 with identifier: SJ72213
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9966a8-c356-5255-a653-a0d5be117057 with scrape type 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_5bed806b272e45b02485b51fa9f92e17.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a819278e3995b6f1ff1e6abe0f17d6b1.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_43aeb7b7127c19eb85b20b8e5aa93589.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_282be7a60e67669c7fa71d1d006efa1e.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_28c3443bef924e04e225008c745b24d1.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_ab8c50f5c815a655cb0774a00460e192.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_e777a0459556193186d253ef25af9506.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a30bb728924aa6bc28ded73b00756d17.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_4460b7363e392ccca09fb566e7c5a82d.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_6ee4abd0f593002850244ac4e351230e.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_d85afd1e0246210f72a5fd3e78aadd86.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_650773fe5ed049d402faeb9ffc7a864a.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_0de587362857585a2128710e30d66f90.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_f4df59eb4f6f0a7c64a30fd7c1419faf.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_658905fdc806e810f0d297d1335a8111.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a29c15f0810381da5870b1894f2371d9.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_fe1c8ea004a57c556080818888868d99.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_61ca705b4762c57d6a6d86cfdd0c9d83.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_a93d0fd871d9488eb919d4c1a36321b8.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ30423> (referer: https://www.auto1.com/v1/car-details-view/VJ30423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9477eb77-0e27-54ef-9314-b36cb5177006 with identifier: VJ30423
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9477eb77-0e27-54ef-9314-b36cb5177006 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_17c460a3e1d9bd10518c5f5949f84265.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d3ef126b7a7f9034f877b0310fd57f00.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_cb79a248282cfe5c3b432f0af5550614.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d406c53558ee56961bd7c58a3acffa29.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_a93d0fd871d9488eb919d4c1a36321b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_10f3df43740ca80da50d8ee28a3f04ae.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_3d7d62b100bd56a4e0c86390c4c3b91b.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_c431b94dc9bf5c981ab9757ef184293b.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_bf969c753a5a19e80a2884a5b5f0f842.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_5e1800ea4a5d262c5c52599baa30c087.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_f95c89aecf4dc70f183bc431113098f8.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d406c53558ee56961bd7c58a3acffa29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1c250>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_a93d0fd871d9488eb919d4c1a36321b8.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011dd10>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d406c53558ee56961bd7c58a3acffa29.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA25017> (referer: https://www.auto1.com/v1/car-details-view/JA25017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY08500> (referer: https://www.auto1.com/v1/car-details-view/PY08500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT78140> (referer: https://www.auto1.com/v1/car-details-view/ZT78140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP77208> (referer: https://www.auto1.com/v1/car-details-view/GP77208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_5e1800ea4a5d262c5c52599baa30c087.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_c431b94dc9bf5c981ab9757ef184293b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_bf969c753a5a19e80a2884a5b5f0f842.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with identifier: JA25017
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_21d38e17b0491e44c0aef00452dbefbd.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d3ef126b7a7f9034f877b0310fd57f00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_3d7d62b100bd56a4e0c86390c4c3b91b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5bc0c64571a64e2d9e7c2fc5cc7cb3f3.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_f95c89aecf4dc70f183bc431113098f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5fdb22e0431197795c0ec33ab16a8920.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fede44e-e2c5-5633-b65e-64cd582f0214 with identifier: PY08500
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fede44e-e2c5-5633-b65e-64cd582f0214 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8dd417e16bdfeeec03f984cd502216be.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_eeaf56320df5f946a8117804bb5c4ec6.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_cb79a248282cfe5c3b432f0af5550614.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_80cabaca9a669c81fb0b169afeb91993.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ed2d8db3cb88bd543547e60290f0cdbc.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_08a880785b68978f47b7912278341b3c.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984eb39a-ea30-517a-ba43-4c5266c4bc99 with identifier: GP77208
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984eb39a-ea30-517a-ba43-4c5266c4bc99 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3d0e8f6bd5886aa12b856c5257c7e473.jpg not downloaded yet
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb1990>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_5e1800ea4a5d262c5c52599baa30c087.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_21d38e17b0491e44c0aef00452dbefbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_10f3df43740ca80da50d8ee28a3f04ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_17c460a3e1d9bd10518c5f5949f84265.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_67fca2b83bc460493cae41dde39eb2a2.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_caf7a6ab3b9892d0eb706345a89fcbe8.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_50cb0f8bff726abe2b4cd22efd99bca0.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_06a77e59881b375b0917e59da1386369.jpg not downloaded yet
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b88790>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_c431b94dc9bf5c981ab9757ef184293b.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c26c50>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_bf969c753a5a19e80a2884a5b5f0f842.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8ef90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d3ef126b7a7f9034f877b0310fd57f00.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189f90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_3d7d62b100bd56a4e0c86390c4c3b91b.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b53250>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_f95c89aecf4dc70f183bc431113098f8.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30194d10>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_cb79a248282cfe5c3b432f0af5550614.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_3936a267ecc59fb1626c03a3cbedaa6b.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_9b98168c47d79490e7ae2447dd30e71d.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_c4683ff83f5e530dcd75ac4cb1074250.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_98d6b3898740ada443bd74d0b56842b9.jpg not downloaded yet
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8dd417e16bdfeeec03f984cd502216be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_61ca705b4762c57d6a6d86cfdd0c9d83.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_eeaf56320df5f946a8117804bb5c4ec6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT17957> (referer: https://www.auto1.com/v1/car-details-view/HT17957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eba710>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_21d38e17b0491e44c0aef00452dbefbd.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcf190>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_10f3df43740ca80da50d8ee28a3f04ae.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f89d0>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_17c460a3e1d9bd10518c5f5949f84265.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9477eb77-0e27-54ef-9314-b36cb5177006
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9477eb77-0e27-54ef-9314-b36cb5177006, skipping ID generation
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9477eb77-0e27-54ef-9314-b36cb5177006 with scrape type 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9477eb77-0e27-54ef-9314-b36cb5177006 sending to next pipeline
2026-04-27 07:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9477eb77-0e27-54ef-9314-b36cb5177006, identifier: VJ30423
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_20c730733946129dbac89183866a8892.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_39de5acb99d5371a02fe7e7fd03ec343.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_fe8915ab678f610caa8a5055fec2a66a.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_301b263fc6062e6678848cf64f6d9e68.jpg not downloaded yet
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9477eb77-0e27-54ef-9314-b36cb5177006 with identifier: VJ30423
2026-04-27 07:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9477eb77-0e27-54ef-9314-b36cb5177006 with identifier: VJ30423
2026-04-27 07:55:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9477eb77-0e27-54ef-9314-b36cb5177006 with identifier: VJ30423 to the API
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_17c460a3e1d9bd10518c5f5949f84265.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:45:56Z',
 'fuel_type': 'petrol',
 'id': '9477eb77-0e27-54ef-9314-b36cb5177006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ30423',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 125127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_17c460a3e1d9bd10518c5f5949f84265.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d3ef126b7a7f9034f877b0310fd57f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_cb79a248282cfe5c3b432f0af5550614.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_d406c53558ee56961bd7c58a3acffa29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_10f3df43740ca80da50d8ee28a3f04ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_3d7d62b100bd56a4e0c86390c4c3b91b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_c431b94dc9bf5c981ab9757ef184293b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_bf969c753a5a19e80a2884a5b5f0f842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_5e1800ea4a5d262c5c52599baa30c087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9477eb77-0e27-54ef-9314-b36cb5177006/9477eb77-0e27-54ef-9314-b36cb5177006_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/91/4191509894906c9754d3434ef9c90374/pa/VJ30423_f95c89aecf4dc70f183bc431113098f8.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Edition Exclusive',
 'transmission': 'automatic',
 'trim': 'T Edition Exclusive',
 'year': 2016}
2026-04-27 07:55:38 [auto1.de] INFO: Saving data for VJ30423: {'created_time': 1777276538.659988, 'last_price_update_time': 1777276538.659999, 'has_photos': True, 'auction_closing_time': 1777391156.0}
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3d0e8f6bd5886aa12b856c5257c7e473.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_08a880785b68978f47b7912278341b3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_e721258095c1e20b5d569a8ac684f4da.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_d35558417a58788d41e3d5b8d0799db3.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_972eea5e81495076f1949a3dc7932d3c.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_323f9b783235ba1e8f80f87d331e1692.jpg not downloaded yet
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE32946> (referer: https://www.auto1.com/v1/car-details-view/PE32946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30093c90>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8dd417e16bdfeeec03f984cd502216be.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcc190>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_61ca705b4762c57d6a6d86cfdd0c9d83.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca2350>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_eeaf56320df5f946a8117804bb5c4ec6.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with identifier: HT17957
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5656bc88831cd999ffdf53ece95837a9.jpg not downloaded yet
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG66334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP83751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE31107> (referer: https://www.auto1.com/v1/car-details-view/CE31107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_caf7a6ab3b9892d0eb706345a89fcbe8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_eb28c18d6523299e7fd6b882c6421a6f.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ce9b2e7fe01f117d314388ac40a2e373.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_501adc84b22ba64937bf4a6be1851f40.jpg not downloaded yet
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_ef9b0a5f3abb6ed51524c538235a865a.jpg not downloaded yet
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_76f187c918f2ab763200940aaed2fcb7.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_06a77e59881b375b0917e59da1386369.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_98d6b3898740ada443bd74d0b56842b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_50cb0f8bff726abe2b4cd22efd99bca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289590>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3d0e8f6bd5886aa12b856c5257c7e473.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e06e10>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_08a880785b68978f47b7912278341b3c.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3001d4d5-c3a3-5989-a583-ddf67de815da with identifier: PE32946
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3001d4d5-c3a3-5989-a583-ddf67de815da with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_753bfd37a18a8aca566d3a98fa4c00e7.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_1e8410f4c8ef076ee6fd7dbd13ca2d13.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ad2138abcebbb12e9b3e8febc2cdca76.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_ebfa893401ac72c067171f4e8fe57927.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_061596b3d8c488c814566d20af7c1afc.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_42e2f34d6c82fa3d1b8cedb62d096d69.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_301b263fc6062e6678848cf64f6d9e68.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_c4683ff83f5e530dcd75ac4cb1074250.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_3967b26cd7846546aba21d592fb70026.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_47dcaf3df641b26838871a30aeeb39e1.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_7d61b4b13f86a59bd2f45dfb88dc41c3.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3e03261a82966e7b289f4bfff10c1bf9.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5a97153d116cb3ce0510b6a8ea6b7e38.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_323f9b783235ba1e8f80f87d331e1692.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5656bc88831cd999ffdf53ece95837a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_fe8915ab678f610caa8a5055fec2a66a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_eb3b45dc34ece32481372bd1947ae244.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL15578> (referer: https://www.auto1.com/v1/car-details-view/GL15578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_9c750f2595222dc5877a3dae2deece0c.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f84fd0>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_caf7a6ab3b9892d0eb706345a89fcbe8.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a01510>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_06a77e59881b375b0917e59da1386369.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a11510>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_98d6b3898740ada443bd74d0b56842b9.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a0e210>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_50cb0f8bff726abe2b4cd22efd99bca0.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_20c730733946129dbac89183866a8892.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_d35558417a58788d41e3d5b8d0799db3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_972eea5e81495076f1949a3dc7932d3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8c72c0b687b1d8a014d630796efbf95d.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_3ba4f026def5f3cf830335cba63fba3f.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_867f3d06d4d111ff841d1b0184ead55d.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5b56f3c7b662a7367eab1313b3bc91b2.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_405992c4f19e31aab207bb5725bb539b.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_4dd28ce02bd21c97fbbc573e9d42ed45.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a16250>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_301b263fc6062e6678848cf64f6d9e68.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d90090>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_c4683ff83f5e530dcd75ac4cb1074250.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_39de5acb99d5371a02fe7e7fd03ec343.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_e721258095c1e20b5d569a8ac684f4da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_1dcd6d9b1e25e4bf6cdd4635e32838c2.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3ad0>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_323f9b783235ba1e8f80f87d331e1692.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f58110>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5656bc88831cd999ffdf53ece95837a9.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9fe50>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_fe8915ab678f610caa8a5055fec2a66a.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with identifier: GL15578
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6ef6255ce50cee1b4f2bd477c93915c1.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_753bfd37a18a8aca566d3a98fa4c00e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_76f187c918f2ab763200940aaed2fcb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_bd1a6de13cdeec9ac8be0ef5c8c1e380.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_c312d31d820de217aba48bace09b81ba.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_3967b26cd7846546aba21d592fb70026.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_42e2f34d6c82fa3d1b8cedb62d096d69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_672d0d4d42f45a765f8c9e5589aaeb94.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV80524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053250>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_20c730733946129dbac89183866a8892.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30281ed0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_d35558417a58788d41e3d5b8d0799db3.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30052150>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_972eea5e81495076f1949a3dc7932d3c.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5a97153d116cb3ce0510b6a8ea6b7e38.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_061596b3d8c488c814566d20af7c1afc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5a021a210d4e8cd06d2384afbff1920b.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_ac49b40c84d74ead4ad2bab238761c6e.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3e03261a82966e7b289f4bfff10c1bf9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7c511d7cdf082ccfa2a5a5a179adae3d.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY90259> (referer: https://www.auto1.com/v1/car-details-view/CY90259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_7d61b4b13f86a59bd2f45dfb88dc41c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7343db42860bfb1cc4aec43589c03e6e.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_0f9c27c529a70e9152bfe643d1f6f5d8.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30075290>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_39de5acb99d5371a02fe7e7fd03ec343.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a03b50>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_e721258095c1e20b5d569a8ac684f4da.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a44ed0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_753bfd37a18a8aca566d3a98fa4c00e7.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d92210>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_76f187c918f2ab763200940aaed2fcb7.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9a10>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_3967b26cd7846546aba21d592fb70026.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d90710>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_42e2f34d6c82fa3d1b8cedb62d096d69.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_867f3d06d4d111ff841d1b0184ead55d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7de44afc8471dae417e0d6db1fcab116.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_4dd28ce02bd21c97fbbc573e9d42ed45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_1dcd6d9b1e25e4bf6cdd4635e32838c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_8527a726f1cd69179fa3fd9f2127602b.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8572eb1f99c5c2644b94ad3b037aed4d.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_47dcaf3df641b26838871a30aeeb39e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6638725acf9f308de6dc561a08221697.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR73975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH89181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5a10>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5a97153d116cb3ce0510b6a8ea6b7e38.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4ebd0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_061596b3d8c488c814566d20af7c1afc.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159790>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3e03261a82966e7b289f4bfff10c1bf9.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_06f38534d55a21ef4d83e2530a0d58b3.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed3b10>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_7d61b4b13f86a59bd2f45dfb88dc41c3.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5b56f3c7b662a7367eab1313b3bc91b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7e3b11633b79ae10815bb18adbaf6eab.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_572270e7a65c3564e88375076a45b540.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_c312d31d820de217aba48bace09b81ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_405992c4f19e31aab207bb5725bb539b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_f4781a655b805951b3f068eb47c4d112.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_e66fa6aabae39691d8aee239e0d9cc2a.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_bd1a6de13cdeec9ac8be0ef5c8c1e380.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5d15de011087fad5b955a39278787a61.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_836bf0d7c95d5bd1faba85f3bc2117e4.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4d9d0>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_867f3d06d4d111ff841d1b0184ead55d.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2d290>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_4dd28ce02bd21c97fbbc573e9d42ed45.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d69d10>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_1dcd6d9b1e25e4bf6cdd4635e32838c2.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67010>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_47dcaf3df641b26838871a30aeeb39e1.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_ac49b40c84d74ead4ad2bab238761c6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_0c3840ec7090734d28b3da203ce40da0.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_f2f51b6bb47c580f0505f72a63b26839.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5a021a210d4e8cd06d2384afbff1920b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_3ba4f026def5f3cf830335cba63fba3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_672d0d4d42f45a765f8c9e5589aaeb94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8a6d18374e51cc086762780757ea4b13.jpg not downloaded yet
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011f790>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5b56f3c7b662a7367eab1313b3bc91b2.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6
2026-04-27 07:55:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5de1a062-6233-5d22-b9a1-a562c5f86bd6, skipping ID generation
2026-04-27 07:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with scrape type 1
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5de1a062-6233-5d22-b9a1-a562c5f86bd6 sending to next pipeline
2026-04-27 07:55:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5de1a062-6233-5d22-b9a1-a562c5f86bd6, identifier: HT17957
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a60950>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_c312d31d820de217aba48bace09b81ba.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1bed0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_405992c4f19e31aab207bb5725bb539b.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7c511d7cdf082ccfa2a5a5a179adae3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1b278832305de98855f2a769dda6aaa1.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_bb2bbfc795a0afa398f0b8d0f750273b.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with identifier: HT17957
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-04-27 07:55:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with identifier: HT17957
2026-04-27 07:55:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5de1a062-6233-5d22-b9a1-a562c5f86bd6 with identifier: HT17957 to the API
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5b56f3c7b662a7367eab1313b3bc91b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:34:49Z',
 'fuel_type': 'petrol',
 'id': '5de1a062-6233-5d22-b9a1-a562c5f86bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT17957',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 142945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5656bc88831cd999ffdf53ece95837a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_76f187c918f2ab763200940aaed2fcb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_42e2f34d6c82fa3d1b8cedb62d096d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5a97153d116cb3ce0510b6a8ea6b7e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5de1a062-6233-5d22-b9a1-a562c5f86bd6/5de1a062-6233-5d22-b9a1-a562c5f86bd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/27/22273ba1bb58eedcdbe1e7631093b297/pa/HT17957_5b56f3c7b662a7367eab1313b3bc91b2.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2002-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-04-27 07:55:42 [auto1.de] INFO: Saving data for HT17957: {'created_time': 1777276542.699892, 'last_price_update_time': 1777276542.699907, 'has_photos': True, 'auction_closing_time': 1777390489.0}
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_0f9c27c529a70e9152bfe643d1f6f5d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_17111caacc2f2f567b24ffaba1703cca.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_ebcfd36d55e45921f8d959f323e1e57c.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_00abf5653d3e83b81be8b06391d4d9f2.jpg not downloaded yet
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5750>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_bd1a6de13cdeec9ac8be0ef5c8c1e380.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22beebd0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_ac49b40c84d74ead4ad2bab238761c6e.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b280d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5a021a210d4e8cd06d2384afbff1920b.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bec9d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_3ba4f026def5f3cf830335cba63fba3f.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f59350>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_672d0d4d42f45a765f8c9e5589aaeb94.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_06f38534d55a21ef4d83e2530a0d58b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_8527a726f1cd69179fa3fd9f2127602b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7343db42860bfb1cc4aec43589c03e6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8572eb1f99c5c2644b94ad3b037aed4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR31319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1f6e099dae8ca8ba6e3c6e1c46dc9664.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_0426953bcbfdeff0078cab021881456b.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbc0d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7c511d7cdf082ccfa2a5a5a179adae3d.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6638725acf9f308de6dc561a08221697.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV80524> (referer: https://www.auto1.com/v1/car-details-view/VV80524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5c990>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_0f9c27c529a70e9152bfe643d1f6f5d8.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_86da008d80cb1fc67b0de31c11380eec.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_bb2bbfc795a0afa398f0b8d0f750273b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_f2f51b6bb47c580f0505f72a63b26839.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_abac4352cd784f7af9c2a674eb700457.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a291d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_06f38534d55a21ef4d83e2530a0d58b3.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bea2d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_8527a726f1cd69179fa3fd9f2127602b.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a214d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7343db42860bfb1cc4aec43589c03e6e.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a089d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8572eb1f99c5c2644b94ad3b037aed4d.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_572270e7a65c3564e88375076a45b540.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5d15de011087fad5b955a39278787a61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_836bf0d7c95d5bd1faba85f3bc2117e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_af96d900cb1177672b38db510b1c15ed.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8a6d18374e51cc086762780757ea4b13.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_17111caacc2f2f567b24ffaba1703cca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0a650>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6638725acf9f308de6dc561a08221697.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-04-27 07:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46d89e1-9bec-5301-bf42-70dd80f01c7e with scrape type 1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30074590>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_bb2bbfc795a0afa398f0b8d0f750273b.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b31610>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_f2f51b6bb47c580f0505f72a63b26839.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_2c6f6917137e92b8d2675344f8d2e9aa.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_0c3840ec7090734d28b3da203ce40da0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df1550>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_572270e7a65c3564e88375076a45b540.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4c1d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5d15de011087fad5b955a39278787a61.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaea10>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_836bf0d7c95d5bd1faba85f3bc2117e4.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bf3810>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8a6d18374e51cc086762780757ea4b13.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eae310>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_17111caacc2f2f567b24ffaba1703cca.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_0426953bcbfdeff0078cab021881456b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 94 pages/min), scraped 59 items (at 39 items/min)
2026-04-27 07:55:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1f6e099dae8ca8ba6e3c6e1c46dc9664.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_ebcfd36d55e45921f8d959f323e1e57c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_00abf5653d3e83b81be8b06391d4d9f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e95fcd0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_0c3840ec7090734d28b3da203ce40da0.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_86da008d80cb1fc67b0de31c11380eec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7e3b11633b79ae10815bb18adbaf6eab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_e66fa6aabae39691d8aee239e0d9cc2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR73975> (referer: https://www.auto1.com/v1/car-details-view/CR73975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2bf50>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_0426953bcbfdeff0078cab021881456b.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f76f90>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1f6e099dae8ca8ba6e3c6e1c46dc9664.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efaed0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_ebcfd36d55e45921f8d959f323e1e57c.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b79d0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_00abf5653d3e83b81be8b06391d4d9f2.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_2c6f6917137e92b8d2675344f8d2e9aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_f4781a655b805951b3f068eb47c4d112.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_abac4352cd784f7af9c2a674eb700457.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH89181> (referer: https://www.auto1.com/v1/car-details-view/ZH89181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efab50>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_86da008d80cb1fc67b0de31c11380eec.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6d50>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7e3b11633b79ae10815bb18adbaf6eab.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30293d10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_e66fa6aabae39691d8aee239e0d9cc2a.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f89c7e3-912b-55d6-810c-6ece71315079 with identifier: CR73975
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f89c7e3-912b-55d6-810c-6ece71315079 with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_76c653372ff19cd2bc439316337d9f4c.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_33b288a7b458e3d915abb676431298eb.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_af96d900cb1177672b38db510b1c15ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ec5341b4a7748f8e57426a8bdf1725de.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c34b10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcca10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc23d0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_2c6f6917137e92b8d2675344f8d2e9aa.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a13d90>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_f4781a655b805951b3f068eb47c4d112.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1c90>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_abac4352cd784f7af9c2a674eb700457.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with identifier: ZH89181
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_c68b270e90b3d348f321e11b3d89efc0.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6ef6255ce50cee1b4f2bd477c93915c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8c72c0b687b1d8a014d630796efbf95d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_e55e6959ad664bfb05bd1afa4cc300a5.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e92c54de665b065491eb8c33df2d8c43.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ff3e2db409ec788347d1bfa6099551c7.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_0bea87d9c44818dd56a6ca99167df7aa.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR31319> (referer: https://www.auto1.com/v1/car-details-view/KR31319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46650>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5a8d0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75b90>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c360d0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7c350>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_af96d900cb1177672b38db510b1c15ed.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2de58bf4-698d-517a-9c72-9c06f59c3952
2026-04-27 07:55:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2de58bf4-698d-517a-9c72-9c06f59c3952, skipping ID generation
2026-04-27 07:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 1
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2de58bf4-698d-517a-9c72-9c06f59c3952 sending to next pipeline
2026-04-27 07:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de58bf4-698d-517a-9c72-9c06f59c3952, identifier: CY90259
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e6241b0e71a7465032a05f0851a8b996.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-04-27 07:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-04-27 07:55:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259 to the API
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_af96d900cb1177672b38db510b1c15ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:06:56Z',
 'fuel_type': 'diesel',
 'id': '2de58bf4-698d-517a-9c72-9c06f59c3952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY90259',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 105578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_06f38534d55a21ef4d83e2530a0d58b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_e66fa6aabae39691d8aee239e0d9cc2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_f2f51b6bb47c580f0505f72a63b26839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_bb2bbfc795a0afa398f0b8d0f750273b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_00abf5653d3e83b81be8b06391d4d9f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_0426953bcbfdeff0078cab021881456b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_86da008d80cb1fc67b0de31c11380eec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_abac4352cd784f7af9c2a674eb700457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_af96d900cb1177672b38db510b1c15ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2de58bf4-698d-517a-9c72-9c06f59c3952/2de58bf4-698d-517a-9c72-9c06f59c3952_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/65/04650765153ccc4f655c7343b971e894/pa/CY90259_2c6f6917137e92b8d2675344f8d2e9aa.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 40 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-04-27 07:55:46 [auto1.de] INFO: Saving data for CY90259: {'created_time': 1777276546.001753, 'last_price_update_time': 1777276546.001763, 'has_photos': True, 'auction_closing_time': 1777388816.0}
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_76c653372ff19cd2bc439316337d9f4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_33b288a7b458e3d915abb676431298eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_9c750f2595222dc5877a3dae2deece0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_eb3b45dc34ece32481372bd1947ae244.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG66334> (referer: https://www.auto1.com/v1/car-details-view/SG66334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7de44afc8471dae417e0d6db1fcab116.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_8a60a4aa185b151324c9a8abb89e834f.jpg not downloaded yet
2026-04-27 07:55:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1250>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6ef6255ce50cee1b4f2bd477c93915c1.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5d50>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6b4d0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8c72c0b687b1d8a014d630796efbf95d.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd2390>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with identifier: KR31319
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_46a4ae5f6b53de4843b26f114711dd2b.jpg not downloaded yet
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP83751> (referer: https://www.auto1.com/v1/car-details-view/BP83751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_17851cf39dea6edf27d95dc921802b7a.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_d30ed88991fbeba919b7c41251c7a9c0.jpg not downloaded yet
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba6e90>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_76c653372ff19cd2bc439316337d9f4c.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a2fd0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_33b288a7b458e3d915abb676431298eb.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e278d0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f68690>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_9c750f2595222dc5877a3dae2deece0c.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3, skipping ID generation
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 sending to next pipeline
2026-04-27 07:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3, identifier: CE31107
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc0ad0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_eb3b45dc34ece32481372bd1947ae244.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3001d4d5-c3a3-5989-a583-ddf67de815da
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3001d4d5-c3a3-5989-a583-ddf67de815da, skipping ID generation
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3001d4d5-c3a3-5989-a583-ddf67de815da with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3001d4d5-c3a3-5989-a583-ddf67de815da sending to next pipeline
2026-04-27 07:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3001d4d5-c3a3-5989-a583-ddf67de815da, identifier: PE32946
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4bc2b7d0>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b46d89e1-9bec-5301-bf42-70dd80f01c7e, skipping ID generation
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46d89e1-9bec-5301-bf42-70dd80f01c7e with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b46d89e1-9bec-5301-bf42-70dd80f01c7e sending to next pipeline
2026-04-27 07:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b46d89e1-9bec-5301-bf42-70dd80f01c7e, identifier: VV80524
2026-04-27 07:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with identifier: SG66334
2026-04-27 07:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with scrape type 1
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_b2b70905f189570dc0d0c3a4af8aef1e.jpg not downloaded yet
2026-04-27 07:55:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c44710>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7de44afc8471dae417e0d6db1fcab116.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_abcc20ffde24bfe59093f52763ca650b.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-04-27 07:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-04-27 07:55:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107 to the API
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_9c750f2595222dc5877a3dae2deece0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:43:21Z',
 'fuel_type': 'petrol',
 'id': 'e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE31107',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 75293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_9c750f2595222dc5877a3dae2deece0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_4dd28ce02bd21c97fbbc573e9d42ed45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_c312d31d820de217aba48bace09b81ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_ac49b40c84d74ead4ad2bab238761c6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_0f9c27c529a70e9152bfe643d1f6f5d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8572eb1f99c5c2644b94ad3b037aed4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_572270e7a65c3564e88375076a45b540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_836bf0d7c95d5bd1faba85f3bc2117e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_8a6d18374e51cc086762780757ea4b13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3/e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/21/ed21420ab5c02ff8ec6aeee502660842/pa/CE31107_17111caacc2f2f567b24ffaba1703cca.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-04-27 07:55:47 [auto1.de] INFO: Saving data for CE31107: {'created_time': 1777276547.491126, 'last_price_update_time': 1777276547.491138, 'has_photos': True, 'auction_closing_time': 1777391001.0}
2026-04-27 07:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3001d4d5-c3a3-5989-a583-ddf67de815da with identifier: PE32946
2026-04-27 07:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3001d4d5-c3a3-5989-a583-ddf67de815da with identifier: PE32946
2026-04-27 07:55:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3001d4d5-c3a3-5989-a583-ddf67de815da with identifier: PE32946 to the API
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_eb3b45dc34ece32481372bd1947ae244.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'city': 'Karlskron',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:19:01Z',
 'fuel_type': 'petrol',
 'id': '3001d4d5-c3a3-5989-a583-ddf67de815da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE32946',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 57114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_753bfd37a18a8aca566d3a98fa4c00e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_3967b26cd7846546aba21d592fb70026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_eb3b45dc34ece32481372bd1947ae244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_405992c4f19e31aab207bb5725bb539b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_bd1a6de13cdeec9ac8be0ef5c8c1e380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5a021a210d4e8cd06d2384afbff1920b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7343db42860bfb1cc4aec43589c03e6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_8527a726f1cd69179fa3fd9f2127602b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_7e3b11633b79ae10815bb18adbaf6eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3001d4d5-c3a3-5989-a583-ddf67de815da/3001d4d5-c3a3-5989-a583-ddf67de815da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8e/1e8e55f7fea465fa1b6610938f5622c3/pa/PE32946_5d15de011087fad5b955a39278787a61.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2020-07-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2020}
2026-04-27 07:55:48 [auto1.de] INFO: Saving data for PE32946: {'created_time': 1777276548.106338, 'last_price_update_time': 1777276548.106351, 'has_photos': True, 'auction_closing_time': 1777389541.0}
2026-04-27 07:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-04-27 07:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-04-27 07:55:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524 to the API
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Erbach',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:39:15Z',
 'fuel_type': 'petrol',
 'id': 'b46d89e1-9bec-5301-bf42-70dd80f01c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV80524',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 104722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2013-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-04-27 07:55:48 [auto1.de] INFO: Saving data for VV80524: {'created_time': 1777276548.591006, 'last_price_update_time': 1777276548.591018, 'has_photos': True, 'auction_closing_time': 1777390755.0}
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_c68b270e90b3d348f321e11b3d89efc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4553626f76a91808ee8fe439fd750bc9.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ad2138abcebbb12e9b3e8febc2cdca76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ec5341b4a7748f8e57426a8bdf1725de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_ebfa893401ac72c067171f4e8fe57927.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_1e8410f4c8ef076ee6fd7dbd13ca2d13.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e92c54de665b065491eb8c33df2d8c43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_213e01a3ca0307a75444079f21e791d4.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-04-27 07:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4b394b-272e-5a9b-93a2-03ed093c7254 with scrape type 1
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_fbb98460b7dc37e50c628571394aa744.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4a8d1a7f9005fcba23503444468723da.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_1a564ce7f0c71c5e275c3017df01e21c.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_847c4811d98477dad29f50df953e9afc.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_841b8551549cebbfecd129effb7f6649.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_f638c071baf32585653fd382d576cc6f.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_6583a3a171360d32789735383f9a6084.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_8a60a4aa185b151324c9a8abb89e834f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ff3e2db409ec788347d1bfa6099551c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_3195019c7c123fb5cd07c2d22953d235.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_3d49dcec0c18ae68f2df7006f883c9d9.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_1ccc90e5b941e106a717f6a1ecdf858c.jpg not downloaded yet
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cef810>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_c68b270e90b3d348f321e11b3d89efc0.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c08450>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ad2138abcebbb12e9b3e8febc2cdca76.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c1dd0>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ec5341b4a7748f8e57426a8bdf1725de.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa7790>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_ebfa893401ac72c067171f4e8fe57927.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f28ad0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_1e8410f4c8ef076ee6fd7dbd13ca2d13.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cac210>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e92c54de665b065491eb8c33df2d8c43.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e6241b0e71a7465032a05f0851a8b996.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_71ad8a3c7a8eaaf68de319b3db791e70.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1b278832305de98855f2a769dda6aaa1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_0bea87d9c44818dd56a6ca99167df7aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_b240f26468fd620506a4fcf8f331a8d8.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_eab76ab7b0d9853135c8f319d9d08327.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_ef9b0a5f3abb6ed51524c538235a865a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_e55e6959ad664bfb05bd1afa4cc300a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_34e37c6b6751ba04acb34e06f5b8fc79.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_458823c424d4368bf189a6965c138c0a.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_b00c36c30a4ce24737ac2312ae717127.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_b2b70905f189570dc0d0c3a4af8aef1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_f67748f60e3114c0ea7be47a280cc997.jpg not downloaded yet
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30132a90>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_8a60a4aa185b151324c9a8abb89e834f.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3dd0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ff3e2db409ec788347d1bfa6099551c7.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_7800737d012a2d6b24f6260b804ff38d.jpg not downloaded yet
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_a172b525a5d17174d42d5dcd8bef4d1d.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ce9b2e7fe01f117d314388ac40a2e373.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_522362e72c58e0c38dbf67d5c7d247ed.jpg not downloaded yet
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_501adc84b22ba64937bf4a6be1851f40.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_bf2ed74a370fb37865cff1678b0b7978.jpg not downloaded yet
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c26910>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e6241b0e71a7465032a05f0851a8b996.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4c410>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1b278832305de98855f2a769dda6aaa1.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d, skipping ID generation
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d sending to next pipeline
2026-04-27 07:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d, identifier: GL15578
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b06490>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_0bea87d9c44818dd56a6ca99167df7aa.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302900d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_ef9b0a5f3abb6ed51524c538235a865a.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 984eb39a-ea30-517a-ba43-4c5266c4bc99
2026-04-27 07:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 984eb39a-ea30-517a-ba43-4c5266c4bc99, skipping ID generation
2026-04-27 07:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984eb39a-ea30-517a-ba43-4c5266c4bc99 with scrape type 1
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 984eb39a-ea30-517a-ba43-4c5266c4bc99 sending to next pipeline
2026-04-27 07:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 984eb39a-ea30-517a-ba43-4c5266c4bc99, identifier: GP77208
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c2b490>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_e55e6959ad664bfb05bd1afa4cc300a5.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f89c7e3-912b-55d6-810c-6ece71315079
2026-04-27 07:55:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f89c7e3-912b-55d6-810c-6ece71315079, skipping ID generation
2026-04-27 07:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f89c7e3-912b-55d6-810c-6ece71315079 with scrape type 1
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f89c7e3-912b-55d6-810c-6ece71315079 sending to next pipeline
2026-04-27 07:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f89c7e3-912b-55d6-810c-6ece71315079, identifier: CR73975
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_abcc20ffde24bfe59093f52763ca650b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_d30ed88991fbeba919b7c41251c7a9c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_30957c5195cd61d77f0ef347df78e6c7.jpg not downloaded yet
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with identifier: GL15578
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with identifier: GL15578
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d with identifier: GL15578 to the API
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1b278832305de98855f2a769dda6aaa1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'city': 'Kerpen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:04:34Z',
 'fuel_type': 'diesel',
 'id': '47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL15578',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 130896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6ef6255ce50cee1b4f2bd477c93915c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_672d0d4d42f45a765f8c9e5589aaeb94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7c511d7cdf082ccfa2a5a5a179adae3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_7de44afc8471dae417e0d6db1fcab116.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_6638725acf9f308de6dc561a08221697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_f4781a655b805951b3f068eb47c4d112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_0c3840ec7090734d28b3da203ce40da0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1b278832305de98855f2a769dda6aaa1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_ebcfd36d55e45921f8d959f323e1e57c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d/47074a57-ba2a-57ce-8f51-fd9ccb9f3e4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/52/d2520ea764aa49024ec7d16bdcb6e318/pa/GL15578_1f6e099dae8ca8ba6e3c6e1c46dc9664.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-04-27 07:55:50 [auto1.de] INFO: Saving data for GL15578: {'created_time': 1777276550.549547, 'last_price_update_time': 1777276550.54956, 'has_photos': True, 'auction_closing_time': 1777388674.0}
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 984eb39a-ea30-517a-ba43-4c5266c4bc99 with identifier: GP77208
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 984eb39a-ea30-517a-ba43-4c5266c4bc99 with identifier: GP77208
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 984eb39a-ea30-517a-ba43-4c5266c4bc99 with identifier: GP77208 to the API
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_ef9b0a5f3abb6ed51524c538235a865a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:47:11Z',
 'fuel_type': 'diesel',
 'id': '984eb39a-ea30-517a-ba43-4c5266c4bc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP77208',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 202906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3d0e8f6bd5886aa12b856c5257c7e473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_06a77e59881b375b0917e59da1386369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_98d6b3898740ada443bd74d0b56842b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_301b263fc6062e6678848cf64f6d9e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_323f9b783235ba1e8f80f87d331e1692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_ef9b0a5f3abb6ed51524c538235a865a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_061596b3d8c488c814566d20af7c1afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_3e03261a82966e7b289f4bfff10c1bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_867f3d06d4d111ff841d1b0184ead55d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_984eb39a-ea30-517a-ba43-4c5266c4bc99/984eb39a-ea30-517a-ba43-4c5266c4bc99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fde5a8c0cac507c238fbb70198bb1/pa/GP77208_1dcd6d9b1e25e4bf6cdd4635e32838c2.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2014-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2014}
2026-04-27 07:55:50 [auto1.de] INFO: Saving data for GP77208: {'created_time': 1777276550.886392, 'last_price_update_time': 1777276550.886402, 'has_photos': True, 'auction_closing_time': 1777391231.0}
2026-04-27 07:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f89c7e3-912b-55d6-810c-6ece71315079 with identifier: CR73975
2026-04-27 07:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f89c7e3-912b-55d6-810c-6ece71315079 with identifier: CR73975
2026-04-27 07:55:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f89c7e3-912b-55d6-810c-6ece71315079 with identifier: CR73975 to the API
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_e55e6959ad664bfb05bd1afa4cc300a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Bocholt',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:25:56Z',
 'fuel_type': 'petrol',
 'id': '4f89c7e3-912b-55d6-810c-6ece71315079',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.8208,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR73975',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'location_confidence': 'geocoded',
 'longitude': 6.6063,
 'make': 'Volkswagen',
 'model': 'Golf III',
 'odometer': 142624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_76c653372ff19cd2bc439316337d9f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_33b288a7b458e3d915abb676431298eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ec5341b4a7748f8e57426a8bdf1725de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_e55e6959ad664bfb05bd1afa4cc300a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f89c7e3-912b-55d6-810c-6ece71315079/4f89c7e3-912b-55d6-810c-6ece71315079_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/89/94897b301281df55e50bc13cdeb5d40b/pa/CR73975_ff3e2db409ec788347d1bfa6099551c7.jpg',
             'Width': 800}],
 'postal_code': '46395',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Münster',
 'province_code': 'DE-055',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '1996-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf III 1.6 Europe',
 'transmission': 'manual',
 'trim': 'Europe',
 'year': 1996}
2026-04-27 07:55:51 [auto1.de] INFO: Saving data for CR73975: {'created_time': 1777276551.2447, 'last_price_update_time': 1777276551.24471, 'has_photos': True, 'auction_closing_time': 1777389956.0}
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_17851cf39dea6edf27d95dc921802b7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_eb28c18d6523299e7fd6b882c6421a6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_dab2197a27344988a9fc8c8b7d2215b0.jpg not downloaded yet
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_9b98168c47d79490e7ae2447dd30e71d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e091d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_b2b70905f189570dc0d0c3a4af8aef1e.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b4610>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ce9b2e7fe01f117d314388ac40a2e373.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d91ed0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_501adc84b22ba64937bf4a6be1851f40.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6617bcf8-7d0d-58bc-af17-a622fc461013
2026-04-27 07:55:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6617bcf8-7d0d-58bc-af17-a622fc461013, skipping ID generation
2026-04-27 07:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 1
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6617bcf8-7d0d-58bc-af17-a622fc461013 sending to next pipeline
2026-04-27 07:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6617bcf8-7d0d-58bc-af17-a622fc461013, identifier: ZT78140
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_f638c071baf32585653fd382d576cc6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_6583a3a171360d32789735383f9a6084.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_92e75e85608830f349205b98738e1e5a.jpg not downloaded yet
2026-04-27 07:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-04-27 07:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-04-27 07:55:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140 to the API
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_501adc84b22ba64937bf4a6be1851f40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 132,
 'expiration_date': '2026-04-28T15:55:21Z',
 'fuel_type': 'petrol',
 'id': '6617bcf8-7d0d-58bc-af17-a622fc461013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT78140',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 62430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_eeaf56320df5f946a8117804bb5c4ec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_08a880785b68978f47b7912278341b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_50cb0f8bff726abe2b4cd22efd99bca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_c4683ff83f5e530dcd75ac4cb1074250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_fe8915ab678f610caa8a5055fec2a66a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_972eea5e81495076f1949a3dc7932d3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_501adc84b22ba64937bf4a6be1851f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_ebfa893401ac72c067171f4e8fe57927.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_7d61b4b13f86a59bd2f45dfb88dc41c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6617bcf8-7d0d-58bc-af17-a622fc461013/6617bcf8-7d0d-58bc-af17-a622fc461013_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/87/6a87a01b731c758a518d1e845a0b31d0/pa/ZT78140_3ba4f026def5f3cf830335cba63fba3f.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2017-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-04-27 07:55:51 [auto1.de] INFO: Saving data for ZT78140: {'created_time': 1777276551.895463, 'last_price_update_time': 1777276551.895475, 'has_photos': True, 'auction_closing_time': 1777391721.0}
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f641d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_abcc20ffde24bfe59093f52763ca650b.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b33510>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_d30ed88991fbeba919b7c41251c7a9c0.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_71ad8a3c7a8eaaf68de319b3db791e70.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_841b8551549cebbfecd129effb7f6649.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_3195019c7c123fb5cd07c2d22953d235.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_1ccc90e5b941e106a717f6a1ecdf858c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_3d49dcec0c18ae68f2df7006f883c9d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a2690>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_17851cf39dea6edf27d95dc921802b7a.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 sending to next pipeline
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0, identifier: ZH89181
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb7d10>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_eb28c18d6523299e7fd6b882c6421a6f.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006c7d0>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_9b98168c47d79490e7ae2447dd30e71d.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with identifier: ZH89181
2026-04-27 07:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with identifier: ZH89181
2026-04-27 07:55:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3161e8c3-9b17-59cc-84ff-ce5f2930ddb0 with identifier: ZH89181 to the API
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_17851cf39dea6edf27d95dc921802b7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Ingolstadt',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:38:49Z',
 'fuel_type': 'petrol',
 'id': '3161e8c3-9b17-59cc-84ff-ce5f2930ddb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.7667,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH89181',
 'listing': 'auction',
 'location': 'DE, Ingolstadt',
 'location_confidence': 'geocoded',
 'longitude': 11.4147,
 'make': 'Mazda',
 'model': '3',
 'odometer': 162084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_c68b270e90b3d348f321e11b3d89efc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e92c54de665b065491eb8c33df2d8c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_0bea87d9c44818dd56a6ca99167df7aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_e6241b0e71a7465032a05f0851a8b996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_8a60a4aa185b151324c9a8abb89e834f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3161e8c3-9b17-59cc-84ff-ce5f2930ddb0/3161e8c3-9b17-59cc-84ff-ce5f2930ddb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c9/25c9f8cdb997d87ed4f33e67461b764c/pa/ZH89181_17851cf39dea6edf27d95dc921802b7a.jpg',
             'Width': 800}],
 'postal_code': '85049',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2009-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 High-Line',
 'transmission': 'manual',
 'trim': 'High-Line',
 'year': 2009}
2026-04-27 07:55:52 [auto1.de] INFO: Saving data for ZH89181: {'created_time': 1777276552.78498, 'last_price_update_time': 1777276552.784992, 'has_photos': True, 'auction_closing_time': 1777390729.0}
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_a172b525a5d17174d42d5dcd8bef4d1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_34e37c6b6751ba04acb34e06f5b8fc79.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9b210>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_f638c071baf32585653fd382d576cc6f.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65ed0>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_6583a3a171360d32789735383f9a6084.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_30957c5195cd61d77f0ef347df78e6c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_bf2ed74a370fb37865cff1678b0b7978.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_7800737d012a2d6b24f6260b804ff38d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_f67748f60e3114c0ea7be47a280cc997.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_522362e72c58e0c38dbf67d5c7d247ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f74950>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_71ad8a3c7a8eaaf68de319b3db791e70.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018b950>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_841b8551549cebbfecd129effb7f6649.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003e050>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_3195019c7c123fb5cd07c2d22953d235.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042c50>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_1ccc90e5b941e106a717f6a1ecdf858c.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f40850>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_3d49dcec0c18ae68f2df7006f883c9d9.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_b00c36c30a4ce24737ac2312ae717127.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_dab2197a27344988a9fc8c8b7d2215b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014ff50>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_a172b525a5d17174d42d5dcd8bef4d1d.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdf710>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_34e37c6b6751ba04acb34e06f5b8fc79.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d84650>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_30957c5195cd61d77f0ef347df78e6c7.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f47210>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_bf2ed74a370fb37865cff1678b0b7978.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005b4d0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_7800737d012a2d6b24f6260b804ff38d.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46a50>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_f67748f60e3114c0ea7be47a280cc997.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300575d0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_522362e72c58e0c38dbf67d5c7d247ed.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_847c4811d98477dad29f50df953e9afc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_458823c424d4368bf189a6965c138c0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_92e75e85608830f349205b98738e1e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_eab76ab7b0d9853135c8f319d9d08327.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_b240f26468fd620506a4fcf8f331a8d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c264d0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_b00c36c30a4ce24737ac2312ae717127.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bc7d50>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_dab2197a27344988a9fc8c8b7d2215b0.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_fbb98460b7dc37e50c628571394aa744.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_46a4ae5f6b53de4843b26f114711dd2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8cad0>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_847c4811d98477dad29f50df953e9afc.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e090>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_458823c424d4368bf189a6965c138c0a.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0bf50>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_92e75e85608830f349205b98738e1e5a.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_213e01a3ca0307a75444079f21e791d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4553626f76a91808ee8fe439fd750bc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4a8d1a7f9005fcba23503444468723da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5790>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_eab76ab7b0d9853135c8f319d9d08327.jpg saved to cache
2026-04-27 07:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3290>
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_b240f26468fd620506a4fcf8f331a8d8.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_80cabaca9a669c81fb0b169afeb91993.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_67fca2b83bc460493cae41dde39eb2a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_3936a267ecc59fb1626c03a3cbedaa6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ed2d8db3cb88bd543547e60290f0cdbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f7b510>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_fbb98460b7dc37e50c628571394aa744.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e4b394b-272e-5a9b-93a2-03ed093c7254
2026-04-27 07:55:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e4b394b-272e-5a9b-93a2-03ed093c7254, skipping ID generation
2026-04-27 07:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4b394b-272e-5a9b-93a2-03ed093c7254 with scrape type 1
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e4b394b-272e-5a9b-93a2-03ed093c7254 sending to next pipeline
2026-04-27 07:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e4b394b-272e-5a9b-93a2-03ed093c7254, identifier: BP83751
2026-04-27 07:55:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4c476590>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_46a4ae5f6b53de4843b26f114711dd2b.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-04-27 07:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-04-27 07:55:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751 to the API
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_fbb98460b7dc37e50c628571394aa744.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'city': 'Kandel',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:56:48Z',
 'fuel_type': 'petrol',
 'id': '9e4b394b-272e-5a9b-93a2-03ed093c7254',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP83751',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 202538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_fbb98460b7dc37e50c628571394aa744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_847c4811d98477dad29f50df953e9afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_6583a3a171360d32789735383f9a6084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_1ccc90e5b941e106a717f6a1ecdf858c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_eab76ab7b0d9853135c8f319d9d08327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_b00c36c30a4ce24737ac2312ae717127.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_a172b525a5d17174d42d5dcd8bef4d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_bf2ed74a370fb37865cff1678b0b7978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_dab2197a27344988a9fc8c8b7d2215b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e4b394b-272e-5a9b-93a2-03ed093c7254/9e4b394b-272e-5a9b-93a2-03ed093c7254_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8b/428b2e9795e76f4af2813dc45d705b60/pa/BP83751_92e75e85608830f349205b98738e1e5a.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2011-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat CC 1.8 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-04-27 07:55:54 [auto1.de] INFO: Saving data for BP83751: {'created_time': 1777276554.885606, 'last_price_update_time': 1777276554.885616, 'has_photos': True, 'auction_closing_time': 1777391808.0}
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_0de587362857585a2128710e30d66f90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_fe1c8ea004a57c556080818888868d99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5fdb22e0431197795c0ec33ab16a8920.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5bc0c64571a64e2d9e7c2fc5cc7cb3f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302ca090>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_213e01a3ca0307a75444079f21e791d4.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0c50>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4553626f76a91808ee8fe439fd750bc9.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30143ed0>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4a8d1a7f9005fcba23503444468723da.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e, skipping ID generation
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e sending to next pipeline
2026-04-27 07:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e, identifier: SG66334
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d93c10>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_80cabaca9a669c81fb0b169afeb91993.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30142310>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_67fca2b83bc460493cae41dde39eb2a2.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014d390>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_3936a267ecc59fb1626c03a3cbedaa6b.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdd350>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ed2d8db3cb88bd543547e60290f0cdbc.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fede44e-e2c5-5633-b65e-64cd582f0214
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fede44e-e2c5-5633-b65e-64cd582f0214, skipping ID generation
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fede44e-e2c5-5633-b65e-64cd582f0214 with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fede44e-e2c5-5633-b65e-64cd582f0214 sending to next pipeline
2026-04-27 07:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fede44e-e2c5-5633-b65e-64cd582f0214, identifier: PY08500
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a29c15f0810381da5870b1894f2371d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_658905fdc806e810f0d297d1335a8111.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_f4df59eb4f6f0a7c64a30fd7c1419faf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with identifier: SG66334
2026-04-27 07:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with identifier: SG66334
2026-04-27 07:55:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60a17610-de5e-5b2d-8ccd-3c036a4b0e7e with identifier: SG66334 to the API
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4a8d1a7f9005fcba23503444468723da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'city': 'Zörbig',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:45:43Z',
 'fuel_type': 'petrol',
 'id': '60a17610-de5e-5b2d-8ccd-3c036a4b0e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.6289,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66334',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'location_confidence': 'geocoded',
 'longitude': 12.1174,
 'make': 'Audi',
 'model': 'A1',
 'odometer': 181115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_b2b70905f189570dc0d0c3a4af8aef1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4553626f76a91808ee8fe439fd750bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_4a8d1a7f9005fcba23503444468723da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_841b8551549cebbfecd129effb7f6649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_3195019c7c123fb5cd07c2d22953d235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_71ad8a3c7a8eaaf68de319b3db791e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_34e37c6b6751ba04acb34e06f5b8fc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_f67748f60e3114c0ea7be47a280cc997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_522362e72c58e0c38dbf67d5c7d247ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60a17610-de5e-5b2d-8ccd-3c036a4b0e7e/60a17610-de5e-5b2d-8ccd-3c036a4b0e7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e5/3ce50768bce76b1ba08f6797f0991bbb/pa/SG66334_30957c5195cd61d77f0ef347df78e6c7.jpg',
             'Width': 800}],
 'postal_code': '06780',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-09-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-04-27 07:55:55 [auto1.de] INFO: Saving data for SG66334: {'created_time': 1777276555.854042, 'last_price_update_time': 1777276555.854054, 'has_photos': True, 'auction_closing_time': 1777391143.0}
2026-04-27 07:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fede44e-e2c5-5633-b65e-64cd582f0214 with identifier: PY08500
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-04-27 07:55:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fede44e-e2c5-5633-b65e-64cd582f0214 with identifier: PY08500
2026-04-27 07:55:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fede44e-e2c5-5633-b65e-64cd582f0214 with identifier: PY08500 to the API
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ed2d8db3cb88bd543547e60290f0cdbc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Karlskron',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:06:00Z',
 'fuel_type': 'diesel',
 'id': '3fede44e-e2c5-5633-b65e-64cd582f0214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY08500',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 133117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8dd417e16bdfeeec03f984cd502216be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ed2d8db3cb88bd543547e60290f0cdbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_caf7a6ab3b9892d0eb706345a89fcbe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_9b98168c47d79490e7ae2447dd30e71d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_39de5acb99d5371a02fe7e7fd03ec343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_d35558417a58788d41e3d5b8d0799db3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ce9b2e7fe01f117d314388ac40a2e373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_ad2138abcebbb12e9b3e8febc2cdca76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_47dcaf3df641b26838871a30aeeb39e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fede44e-e2c5-5633-b65e-64cd582f0214/3fede44e-e2c5-5633-b65e-64cd582f0214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/22/ec2264fd812dd41c8d8efaf68af5f91e/pa/PY08500_8c72c0b687b1d8a014d630796efbf95d.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-04-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2017}
2026-04-27 07:55:56 [auto1.de] INFO: Saving data for PY08500: {'created_time': 1777276556.400083, 'last_price_update_time': 1777276556.400093, 'has_photos': True, 'auction_closing_time': 1777388760.0}
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_4460b7363e392ccca09fb566e7c5a82d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_6ee4abd0f593002850244ac4e351230e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_650773fe5ed049d402faeb9ffc7a864a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_d85afd1e0246210f72a5fd3e78aadd86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c84950>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_0de587362857585a2128710e30d66f90.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30142710>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_fe1c8ea004a57c556080818888868d99.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006c1d0>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5fdb22e0431197795c0ec33ab16a8920.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb7210>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5bc0c64571a64e2d9e7c2fc5cc7cb3f3.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c0f7da7-c87f-5c18-8da9-95ac9458af59, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c0f7da7-c87f-5c18-8da9-95ac9458af59 sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c0f7da7-c87f-5c18-8da9-95ac9458af59, identifier: JA25017
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bc4c10>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a29c15f0810381da5870b1894f2371d9.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208a290>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_658905fdc806e810f0d297d1335a8111.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf1710>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_f4df59eb4f6f0a7c64a30fd7c1419faf.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with identifier: JA25017
2026-04-27 07:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with identifier: JA25017
2026-04-27 07:55:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c0f7da7-c87f-5c18-8da9-95ac9458af59 with identifier: JA25017 to the API
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5bc0c64571a64e2d9e7c2fc5cc7cb3f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Hemau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:52:01Z',
 'fuel_type': 'diesel',
 'id': '6c0f7da7-c87f-5c18-8da9-95ac9458af59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0383,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA25017',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'location_confidence': 'geocoded',
 'longitude': 11.8522,
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 84652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_21d38e17b0491e44c0aef00452dbefbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5bc0c64571a64e2d9e7c2fc5cc7cb3f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_5fdb22e0431197795c0ec33ab16a8920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_80cabaca9a669c81fb0b169afeb91993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_67fca2b83bc460493cae41dde39eb2a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_3936a267ecc59fb1626c03a3cbedaa6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_20c730733946129dbac89183866a8892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_e721258095c1e20b5d569a8ac684f4da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_eb28c18d6523299e7fd6b882c6421a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c0f7da7-c87f-5c18-8da9-95ac9458af59/6c0f7da7-c87f-5c18-8da9-95ac9458af59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38503e3cd680cb235385753296bc5f4/pa/JA25017_1e8410f4c8ef076ee6fd7dbd13ca2d13.jpg',
             'Width': 800}],
 'postal_code': '93155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Palatinate',
 'province_code': 'DE-093',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2020-06-15',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 Diesel M Selection L2',
 'transmission': 'manual',
 'trim': 'M Selection L2',
 'year': 2020}
2026-04-27 07:55:57 [auto1.de] INFO: Saving data for JA25017: {'created_time': 1777276557.351388, 'last_price_update_time': 1777276557.3514, 'has_photos': True, 'auction_closing_time': 1777391521.0}
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_ab8c50f5c815a655cb0774a00460e192.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a30bb728924aa6bc28ded73b00756d17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_e777a0459556193186d253ef25af9506.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_43aeb7b7127c19eb85b20b8e5aa93589.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a819278e3995b6f1ff1e6abe0f17d6b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_28c3443bef924e04e225008c745b24d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_282be7a60e67669c7fa71d1d006efa1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf2850>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_4460b7363e392ccca09fb566e7c5a82d.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301409d0>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_6ee4abd0f593002850244ac4e351230e.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4d110>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_650773fe5ed049d402faeb9ffc7a864a.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bc4d10>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_d85afd1e0246210f72a5fd3e78aadd86.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_664fa818036fd9c227b83da4af62310f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_5bed806b272e45b02485b51fa9f92e17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b5450>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_ab8c50f5c815a655cb0774a00460e192.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4eb10>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a30bb728924aa6bc28ded73b00756d17.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bb2410>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_e777a0459556193186d253ef25af9506.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d390>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_43aeb7b7127c19eb85b20b8e5aa93589.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0250>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a819278e3995b6f1ff1e6abe0f17d6b1.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30303890>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_28c3443bef924e04e225008c745b24d1.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a28a10>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_282be7a60e67669c7fa71d1d006efa1e.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4f050>
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_664fa818036fd9c227b83da4af62310f.jpg saved to cache
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e5f67de-4917-5a80-90d5-38cb58253c1e
2026-04-27 07:55:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e5f67de-4917-5a80-90d5-38cb58253c1e, skipping ID generation
2026-04-27 07:55:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5f67de-4917-5a80-90d5-38cb58253c1e with scrape type 1
2026-04-27 07:55:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e5f67de-4917-5a80-90d5-38cb58253c1e sending to next pipeline
2026-04-27 07:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e5f67de-4917-5a80-90d5-38cb58253c1e, identifier: AG26382
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3210d210>
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_5bed806b272e45b02485b51fa9f92e17.jpg saved to cache
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a9966a8-c356-5255-a653-a0d5be117057
2026-04-27 07:55:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a9966a8-c356-5255-a653-a0d5be117057, skipping ID generation
2026-04-27 07:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9966a8-c356-5255-a653-a0d5be117057 with scrape type 1
2026-04-27 07:55:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a9966a8-c356-5255-a653-a0d5be117057 sending to next pipeline
2026-04-27 07:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a9966a8-c356-5255-a653-a0d5be117057, identifier: SJ72213
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e5f67de-4917-5a80-90d5-38cb58253c1e with identifier: AG26382
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e5f67de-4917-5a80-90d5-38cb58253c1e with identifier: AG26382
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e5f67de-4917-5a80-90d5-38cb58253c1e with identifier: AG26382 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_664fa818036fd9c227b83da4af62310f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'city': 'Kandel',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 238,
 'expiration_date': '2026-04-28T15:19:50Z',
 'fuel_type': 'petrol',
 'id': '6e5f67de-4917-5a80-90d5-38cb58253c1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG26382',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 77611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_664fa818036fd9c227b83da4af62310f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a819278e3995b6f1ff1e6abe0f17d6b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_282be7a60e67669c7fa71d1d006efa1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_ab8c50f5c815a655cb0774a00460e192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a30bb728924aa6bc28ded73b00756d17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_6ee4abd0f593002850244ac4e351230e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_650773fe5ed049d402faeb9ffc7a864a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_f4df59eb4f6f0a7c64a30fd7c1419faf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_a29c15f0810381da5870b1894f2371d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e5f67de-4917-5a80-90d5-38cb58253c1e/6e5f67de-4917-5a80-90d5-38cb58253c1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/fe/bffeff75ba209bdd8bbaadf0fba88f7a/pa/AG26382_61ca705b4762c57d6a6d86cfdd0c9d83.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2023-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 250 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-04-27 07:55:58 [auto1.de] INFO: Saving data for AG26382: {'created_time': 1777276558.751191, 'last_price_update_time': 1777276558.751202, 'has_photos': True, 'auction_closing_time': 1777389590.0}
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a9966a8-c356-5255-a653-a0d5be117057 with identifier: SJ72213
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a9966a8-c356-5255-a653-a0d5be117057 with identifier: SJ72213
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a9966a8-c356-5255-a653-a0d5be117057 with identifier: SJ72213 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_5bed806b272e45b02485b51fa9f92e17.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Ellerau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:22:14Z',
 'fuel_type': 'petrol',
 'id': '3a9966a8-c356-5255-a653-a0d5be117057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ72213',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 41901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_5bed806b272e45b02485b51fa9f92e17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_43aeb7b7127c19eb85b20b8e5aa93589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_28c3443bef924e04e225008c745b24d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_e777a0459556193186d253ef25af9506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_4460b7363e392ccca09fb566e7c5a82d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_d85afd1e0246210f72a5fd3e78aadd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_0de587362857585a2128710e30d66f90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_658905fdc806e810f0d297d1335a8111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_fe1c8ea004a57c556080818888868d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3a9966a8-c356-5255-a653-a0d5be117057/3a9966a8-c356-5255-a653-a0d5be117057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/28/5c286ea5905dde5adb4a9244df387886/pa/SJ72213_a93d0fd871d9488eb919d4c1a36321b8.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2017-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-04-27 07:55:59 [auto1.de] INFO: Saving data for SJ72213: {'created_time': 1777276559.265347, 'last_price_update_time': 1777276559.265357, 'has_photos': True, 'auction_closing_time': 1777389734.0}
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV10415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR78319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF59010> (referer: https://www.auto1.com/v1/car-details-view/NF59010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_1a564ce7f0c71c5e275c3017df01e21c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6005b0f-b839-5744-87b0-d82290fe48c7 with identifier: NF59010
2026-04-27 07:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6005b0f-b839-5744-87b0-d82290fe48c7 with scrape type 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_432347e6c4ace0722914b7569ee1d99e.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_07417a16aa0776a191b251471d5f1d75.jpg not downloaded yet
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_46f33434757fec3842ffea8695751416.jpg not downloaded yet
2026-04-27 07:55:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b33f50>
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_1a564ce7f0c71c5e275c3017df01e21c.jpg saved to cache
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99
2026-04-27 07:55:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99, skipping ID generation
2026-04-27 07:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with scrape type 1
2026-04-27 07:55:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99, identifier: KR31319
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ce0e01d2adb9229d352bef77bcfa3742.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with identifier: KR31319
2026-04-27 07:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with identifier: KR31319
2026-04-27 07:56:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99 with identifier: KR31319 to the API
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_1a564ce7f0c71c5e275c3017df01e21c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Schwerin',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:14:31Z',
 'fuel_type': 'diesel',
 'id': '8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.15,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR31319',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'location_confidence': 'geocoded',
 'longitude': 13.6333,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 273184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_46a4ae5f6b53de4843b26f114711dd2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_d30ed88991fbeba919b7c41251c7a9c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_abcc20ffde24bfe59093f52763ca650b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_213e01a3ca0307a75444079f21e791d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_1a564ce7f0c71c5e275c3017df01e21c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_f638c071baf32585653fd382d576cc6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_3d49dcec0c18ae68f2df7006f883c9d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_b240f26468fd620506a4fcf8f331a8d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_458823c424d4368bf189a6965c138c0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99/8d74c3b7-7dd0-5bd7-8ae6-ff44197f5a99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/a3/51a339b0276aff51287f34963cf479da/pa/KR31319_7800737d012a2d6b24f6260b804ff38d.jpg',
             'Width': 800}],
 'postal_code': '15755',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-04-27 07:56:00 [auto1.de] INFO: Saving data for KR31319: {'created_time': 1777276560.491459, 'last_price_update_time': 1777276560.491468, 'has_photos': True, 'auction_closing_time': 1777389271.0}
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_7ad44ae5ed39dc15516f124c49df0ec3.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR44160> (referer: https://www.auto1.com/v1/car-details-view/ZR44160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH83727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN99537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR24520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM42561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_77703bc60f1deb4ec8184aa4fe0707bc.jpg not downloaded yet
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_52176c4075d51bfa4c30d6fb2e4f45fa.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ea1d9e47d33b565dc9973b28b0e895f8.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_fe767187a49d49caff892f7bdc590eb4.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_d0208d29c69a50c4e692b7fbf3aefee5.jpg not downloaded yet
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_432347e6c4ace0722914b7569ee1d99e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2aabc03-a2bf-5e62-84d8-36609c134ba8 with identifier: ZR44160
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2aabc03-a2bf-5e62-84d8-36609c134ba8 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_4215b41b539b4f7b71b90759b6238ce0.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_1924fc8e45d851e5e524d373876fa19f.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_fbcceff7b8a03b4d316673fa95a6fefc.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_590821da0febfa5f110766296f213a35.jpg not downloaded yet
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_7f4587abd45faedca871e59e91fa2953.jpg not downloaded yet
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef8810>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_432347e6c4ace0722914b7569ee1d99e.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_46f33434757fec3842ffea8695751416.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ce0e01d2adb9229d352bef77bcfa3742.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_7ad44ae5ed39dc15516f124c49df0ec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_07417a16aa0776a191b251471d5f1d75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_d0208d29c69a50c4e692b7fbf3aefee5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a134d0>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_46f33434757fec3842ffea8695751416.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2a1d0>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ce0e01d2adb9229d352bef77bcfa3742.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a0b810>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_7ad44ae5ed39dc15516f124c49df0ec3.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301409d0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_07417a16aa0776a191b251471d5f1d75.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7ebd0>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_d0208d29c69a50c4e692b7fbf3aefee5.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_590821da0febfa5f110766296f213a35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_7f4587abd45faedca871e59e91fa2953.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60450>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_590821da0febfa5f110766296f213a35.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ad910>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_7f4587abd45faedca871e59e91fa2953.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_fbcceff7b8a03b4d316673fa95a6fefc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL95157> (referer: https://www.auto1.com/v1/car-details-view/YL95157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND23678> (referer: https://www.auto1.com/v1/car-details-view/ND23678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM47084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG22932> (referer: https://www.auto1.com/v1/car-details-view/CG22932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ84209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_4215b41b539b4f7b71b90759b6238ce0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bf3e90>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_fbcceff7b8a03b4d316673fa95a6fefc.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_fe767187a49d49caff892f7bdc590eb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_1924fc8e45d851e5e524d373876fa19f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349b638f-de95-5200-9efe-8f0b8c30ef07 with identifier: YL95157
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349b638f-de95-5200-9efe-8f0b8c30ef07 with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_223d1854c30874d5ca5d790250f34d23.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10002550-1074-57c4-9820-62c0ff499daa with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f38dbe-d798-5fc7-a1f4-ab657971b48b with identifier: CG22932
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_4d704a5ad4d088bf1c7f06d8b4f3c61b.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_254ce7635146ce862913d275b697eef7.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_e28d68725854ed16bba5f8d614dda968.jpg not downloaded yet
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ27680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_703366e89adc0306a74fec1ac4b09843.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_5bde2bc6fd126e69a91acdee54e08223.jpg not downloaded yet
2026-04-27 07:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2bf50>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_4215b41b539b4f7b71b90759b6238ce0.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_52176c4075d51bfa4c30d6fb2e4f45fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ea1d9e47d33b565dc9973b28b0e895f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_77703bc60f1deb4ec8184aa4fe0707bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_56ed6229ecebb2a4ba38517fbe326263.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg not downloaded yet
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_6fbd132afaac9072443dca7609881809.jpg not downloaded yet
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1ee50>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_fe767187a49d49caff892f7bdc590eb4.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d93f10>
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_1924fc8e45d851e5e524d373876fa19f.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2aabc03-a2bf-5e62-84d8-36609c134ba8
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2aabc03-a2bf-5e62-84d8-36609c134ba8, skipping ID generation
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2aabc03-a2bf-5e62-84d8-36609c134ba8 with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2aabc03-a2bf-5e62-84d8-36609c134ba8 sending to next pipeline
2026-04-27 07:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2aabc03-a2bf-5e62-84d8-36609c134ba8, identifier: ZR44160
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_b4144fc10f98a4788e4f2ddafb59eb71.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_87940000d35e282c951df32d63a502a8.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2aabc03-a2bf-5e62-84d8-36609c134ba8 with identifier: ZR44160
2026-04-27 07:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2aabc03-a2bf-5e62-84d8-36609c134ba8 with identifier: ZR44160
2026-04-27 07:56:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2aabc03-a2bf-5e62-84d8-36609c134ba8 with identifier: ZR44160 to the API
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_1924fc8e45d851e5e524d373876fa19f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Erbach',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:11:58Z',
 'fuel_type': 'petrol',
 'id': 'c2aabc03-a2bf-5e62-84d8-36609c134ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR44160',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 137803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_4215b41b539b4f7b71b90759b6238ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_1924fc8e45d851e5e524d373876fa19f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_fbcceff7b8a03b4d316673fa95a6fefc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_590821da0febfa5f110766296f213a35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c2aabc03-a2bf-5e62-84d8-36609c134ba8/c2aabc03-a2bf-5e62-84d8-36609c134ba8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/55/1f5528b4b45cda283a6c028b7f35f387/pa/ZR44160_7f4587abd45faedca871e59e91fa2953.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2010-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-04-27 07:56:02 [auto1.de] INFO: Saving data for ZR44160: {'created_time': 1777276562.681508, 'last_price_update_time': 1777276562.681524, 'has_photos': True, 'auction_closing_time': 1777389118.0}
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_e28d68725854ed16bba5f8d614dda968.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_daa19f6945ada7596c6f45591ad6a1d5.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg not downloaded yet
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_f4d14662ec24e3925336b9e5e2720b0e.jpg not downloaded yet
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN60683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA67645> (referer: https://www.auto1.com/v1/car-details-view/VA67645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR78319> (referer: https://www.auto1.com/v1/car-details-view/AR78319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dac350>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_52176c4075d51bfa4c30d6fb2e4f45fa.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc7a90>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ea1d9e47d33b565dc9973b28b0e895f8.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c458d0>
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_77703bc60f1deb4ec8184aa4fe0707bc.jpg saved to cache
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6005b0f-b839-5744-87b0-d82290fe48c7
2026-04-27 07:56:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6005b0f-b839-5744-87b0-d82290fe48c7, skipping ID generation
2026-04-27 07:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6005b0f-b839-5744-87b0-d82290fe48c7 with scrape type 1
2026-04-27 07:56:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6005b0f-b839-5744-87b0-d82290fe48c7 sending to next pipeline
2026-04-27 07:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6005b0f-b839-5744-87b0-d82290fe48c7, identifier: NF59010
2026-04-27 07:56:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE18089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6005b0f-b839-5744-87b0-d82290fe48c7 with identifier: NF59010
2026-04-27 07:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6005b0f-b839-5744-87b0-d82290fe48c7 with identifier: NF59010
2026-04-27 07:56:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6005b0f-b839-5744-87b0-d82290fe48c7 with identifier: NF59010 to the API
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_77703bc60f1deb4ec8184aa4fe0707bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Kerpen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-04-28T15:18:42Z',
 'fuel_type': 'petrol',
 'id': 'f6005b0f-b839-5744-87b0-d82290fe48c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF59010',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 13601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_432347e6c4ace0722914b7569ee1d99e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_07417a16aa0776a191b251471d5f1d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_46f33434757fec3842ffea8695751416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ce0e01d2adb9229d352bef77bcfa3742.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_7ad44ae5ed39dc15516f124c49df0ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_77703bc60f1deb4ec8184aa4fe0707bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_52176c4075d51bfa4c30d6fb2e4f45fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_ea1d9e47d33b565dc9973b28b0e895f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_fe767187a49d49caff892f7bdc590eb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f6005b0f-b839-5744-87b0-d82290fe48c7/f6005b0f-b839-5744-87b0-d82290fe48c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/17/32176993097e5b17b056ab24cf669ad3/pa/NF59010_d0208d29c69a50c4e692b7fbf3aefee5.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2023-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2023}
2026-04-27 07:56:03 [auto1.de] INFO: Saving data for NF59010: {'created_time': 1777276563.453187, 'last_price_update_time': 1777276563.453199, 'has_photos': True, 'auction_closing_time': 1777389522.0}
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_5bde2bc6fd126e69a91acdee54e08223.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_760c3dfc935b97aed779186f64bba832.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_b5a66ab1b2cac6d1635196b7115ef304.jpg not downloaded yet
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_6fbd132afaac9072443dca7609881809.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_0c4b7d7d632c56915001b748e40e0ec3.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_fc4bb7d7da627f4896a81cd876db32cb.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM42561> (referer: https://www.auto1.com/v1/car-details-view/MM42561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc49d0>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_e28d68725854ed16bba5f8d614dda968.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60771452-6393-52f9-a8a1-8a5724ca4e9f with identifier: VA67645
2026-04-27 07:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60771452-6393-52f9-a8a1-8a5724ca4e9f with scrape type 1
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_2b657456ecde418b4b4e26f609234e6c.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd612883-323e-5925-b065-c6b44120f499 with identifier: AR78319
2026-04-27 07:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd612883-323e-5925-b065-c6b44120f499 with scrape type 1
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_6e3603329f2f1579e0e9288722bc7467.jpg not downloaded yet
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_09595fd3845e1f21853ada63405c8909.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_2581ded0252477a208eccd92714d1682.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e886155579513344466a9ed53daff1de.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_475b5e5fdf8f09f37a8b87d744bbb4fe.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_f4d14662ec24e3925336b9e5e2720b0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_87940000d35e282c951df32d63a502a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22beb2d0>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_5bde2bc6fd126e69a91acdee54e08223.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b7090>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_6fbd132afaac9072443dca7609881809.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f66d10>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_daa19f6945ada7596c6f45591ad6a1d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_8a0c6b6e04863a0572ccaf80f67e4e33.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_834cfc3680cf6b52ba00ea5581f885d3.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e85512ad0d432b667d31216e8eaa4b69.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_83fdae95c094b0c132ffb04e7e42b802.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_b5a66ab1b2cac6d1635196b7115ef304.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_b4144fc10f98a4788e4f2ddafb59eb71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with identifier: MM42561
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_bafdc90a38a5c08544e4b2b4fa859903.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_8346e25438bf43cd0b1c70d90fbbfed7.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_e8d44126fa22ab8e038679e71cccd33c.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR24520> (referer: https://www.auto1.com/v1/car-details-view/WR24520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d69e90>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e434d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_f4d14662ec24e3925336b9e5e2720b0e.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30056450>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_87940000d35e282c951df32d63a502a8.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_7a49cae514f0336366236a98b52a3944.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_6e3603329f2f1579e0e9288722bc7467.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_5edfd0ccd0a59199e95c1c7ef56e74e9.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_d8265f2698a35ea7a79f124904b9abcb.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030af10>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_daa19f6945ada7596c6f45591ad6a1d5.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_475b5e5fdf8f09f37a8b87d744bbb4fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_301c9251f2139cf406ef4870f205669d.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7b050>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_b5a66ab1b2cac6d1635196b7115ef304.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300574d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_b4144fc10f98a4788e4f2ddafb59eb71.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e8d50>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44514486-a14f-55c0-b3aa-ba2df99a69a3 with identifier: WR24520
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44514486-a14f-55c0-b3aa-ba2df99a69a3 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f5dde38ee7da3c5223f2e138e267b5ea.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e22ad261355f80902b294ded2cac5f46.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_01e86168402ad31c7ef318f1b1d2d451.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_0a3a6d5a43baf47dacb4a23c07066d53.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_73963057e49c133f31490fc4aac08940.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_2b657456ecde418b4b4e26f609234e6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_83fdae95c094b0c132ffb04e7e42b802.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_bafdc90a38a5c08544e4b2b4fa859903.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_2581ded0252477a208eccd92714d1682.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_b2cf2f1bc239a84a3856295f92a928f8.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_bcc21fed365d6607327d69e08861ede6.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3029af50>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_6e3603329f2f1579e0e9288722bc7467.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff3190>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_475b5e5fdf8f09f37a8b87d744bbb4fe.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_f4b9014982f6a127e85dfe9832c717fa.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_92a6a3c3fa49fcacef1df45e01b380c7.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK11851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_48136f05e1cb06da43c8624b7ef299b8.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_a4f0ff3b58f87e87e21b99cdcea5c447.jpg not downloaded yet
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD40103> (referer: https://www.auto1.com/v1/car-details-view/VD40103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e886155579513344466a9ed53daff1de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_e8d44126fa22ab8e038679e71cccd33c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_cbd47a6366be7eeb06359281e08b03cc.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f47bd94230c44a85aa23caa94932d827.jpg not downloaded yet
2026-04-27 07:56:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3206a150>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_2b657456ecde418b4b4e26f609234e6c.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7afd0>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_83fdae95c094b0c132ffb04e7e42b802.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e98310>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_bafdc90a38a5c08544e4b2b4fa859903.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7a410>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_2581ded0252477a208eccd92714d1682.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_7a49cae514f0336366236a98b52a3944.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_244a376b6dbc6f710bc4ec2f3cec5ca4.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_9e7c02f2f5789958c43ab176206a2816.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH83727> (referer: https://www.auto1.com/v1/car-details-view/FH83727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f5dde38ee7da3c5223f2e138e267b5ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_301c9251f2139cf406ef4870f205669d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_01e86168402ad31c7ef318f1b1d2d451.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_25f86af11f33addaa37e297e579435d1.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_e927ba138b2d49cefdecc3e1f76a99d9.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV10415> (referer: https://www.auto1.com/v1/car-details-view/KV10415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN99537> (referer: https://www.auto1.com/v1/car-details-view/VN99537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD88399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_ee311b33da7c865e7a33d622abe31881.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_f3c124ca3c321e3f4e5aa47e313a279e.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ84209> (referer: https://www.auto1.com/v1/car-details-view/WJ84209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f883b1f6-5b5d-501e-bdb8-880d235310e0 with identifier: VD40103
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f883b1f6-5b5d-501e-bdb8-880d235310e0 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_847e4f0495242384cd83936479e65624.jpg not downloaded yet
2026-04-27 07:56:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006f150>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e886155579513344466a9ed53daff1de.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3025a110>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_e8d44126fa22ab8e038679e71cccd33c.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_8f68c2b37a643f0ac44e428c2cfeb81b.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_95192b3bcd0920841d361893bef058cc.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_b2e98cf8bee34b5e16b87d35b4529d31.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e22ad261355f80902b294ded2cac5f46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_b2cf2f1bc239a84a3856295f92a928f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_f4b9014982f6a127e85dfe9832c717fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_92a6a3c3fa49fcacef1df45e01b380c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_a90dfa39cacc865a81c3305943c7bf3e.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_1ac49bbad91919d75b9d7ac74d858c1b.jpg not downloaded yet
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b33f50>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_7a49cae514f0336366236a98b52a3944.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_95fe85cbe372740f4f75507dcf4c245c.jpg not downloaded yet
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a83090>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f5dde38ee7da3c5223f2e138e267b5ea.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a25090>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_301c9251f2139cf406ef4870f205669d.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a3c950>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_01e86168402ad31c7ef318f1b1d2d451.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aea411f7-b03a-5459-845c-5091a8219192 with identifier: VN99537
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aea411f7-b03a-5459-845c-5091a8219192 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_85e798d0cebfc5240fcb9ac381fcfef9.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b89220-43c1-56a8-ba77-6b38e7b44637 with identifier: WJ84209
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b89220-43c1-56a8-ba77-6b38e7b44637 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_638db69c1e7fc95e541f564a25b0ed52.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_bcc21fed365d6607327d69e08861ede6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_9d30cfad2821b383909c3dbb545a1dd7.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_b8c22300879e2ea094ce1a9dfef1b940.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_df1547b0249633d62b112198f0e042b4.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_e892bd9e98256dff32eacfec66fd3722.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_a8a233a0fdfa3ca99455efc69af0c26a.jpg not downloaded yet
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_b8fef278e9a59277cff383ee5870fc53.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_a4f0ff3b58f87e87e21b99cdcea5c447.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_9e7c02f2f5789958c43ab176206a2816.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_7c2eacf800ba073f1fdc14edddb5764d.jpg not downloaded yet
2026-04-27 07:56:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c3610>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e22ad261355f80902b294ded2cac5f46.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bb18d0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_b2cf2f1bc239a84a3856295f92a928f8.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f44d0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_f4b9014982f6a127e85dfe9832c717fa.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f09d0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_92a6a3c3fa49fcacef1df45e01b380c7.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_afa208de2a36e5fff61eac886c415c6d.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e7df6a0affa9c524aedbe249bf86eb.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_9bbf0a8b1906ce1d019db475cd3a6e8a.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edb4dc436c6453cd551d2af152ed26a7.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_cbd47a6366be7eeb06359281e08b03cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_cf49102edabef7da91990b0e44df9b1f.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a78710>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_bcc21fed365d6607327d69e08861ede6.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f47bd94230c44a85aa23caa94932d827.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_0a3a6d5a43baf47dacb4a23c07066d53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_73963057e49c133f31490fc4aac08940.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_70b70bf59b6430684972e85f4c6d67e8.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_5d8da778e9e150faf2bd6bc4efc2b322.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_bb76e0aae8448cbc46f34ff0f1e00982.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_f5dd7594a12a9f14def51b33a26542ea.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ27680> (referer: https://www.auto1.com/v1/car-details-view/YJ27680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_244a376b6dbc6f710bc4ec2f3cec5ca4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_d2f0b78b2d3a5b9bb1608c32e79f0fa5.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026cb50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_a4f0ff3b58f87e87e21b99cdcea5c447.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e69690>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_9e7c02f2f5789958c43ab176206a2816.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_280f21f5fbf36d8fb8e7e728a18c4fe4.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_ccf96883e6e65024002f7bda5bdd042f.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_435a56ee650395cb728fbda8d71d30e0.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_48136f05e1cb06da43c8624b7ef299b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_e927ba138b2d49cefdecc3e1f76a99d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_95192b3bcd0920841d361893bef058cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_be1b3364988e74fb19c56dc681133869.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_8f68c2b37a643f0ac44e428c2cfeb81b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_4d1b0cbd8ec1af8c513107d1ff3a2e63.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_7e81858a7e6cd1d41c607011099fa9c9.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_2d6d0fed920a1147cda7bce7099f229b.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE18089> (referer: https://www.auto1.com/v1/car-details-view/SE18089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e24a10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_cbd47a6366be7eeb06359281e08b03cc.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b96e10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f47bd94230c44a85aa23caa94932d827.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d82fd0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_0a3a6d5a43baf47dacb4a23c07066d53.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179a10>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_73963057e49c133f31490fc4aac08940.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_f73ce6d8697b53a282d3e91807e45003.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_638db69c1e7fc95e541f564a25b0ed52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_9d30cfad2821b383909c3dbb545a1dd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_b2e98cf8bee34b5e16b87d35b4529d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_2e96877c2c7495b3727eff34dfc3247e.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_340276fa1726fbbeaf98a4c7750dceaf.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_afc5a182dd2358df8b5706368761f12a.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_ef8e5f76c10e125257e8edf4c395a556.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_d416bc2bc63dd4fdcd99aed123ca204d.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_bde1fadd2559d945d5c2fc822e0216d7.jpg not downloaded yet
2026-04-27 07:56:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30090fd0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_244a376b6dbc6f710bc4ec2f3cec5ca4.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3ee10>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_48136f05e1cb06da43c8624b7ef299b8.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30166790>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_e927ba138b2d49cefdecc3e1f76a99d9.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8a310>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_95192b3bcd0920841d361893bef058cc.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e92590>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_8f68c2b37a643f0ac44e428c2cfeb81b.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0efe84-2a89-5d91-a83b-2af72889f48d with identifier: SE18089
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0efe84-2a89-5d91-a83b-2af72889f48d with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_a9db7025fbb7dd3c93ec90d2d4290f03.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e9d6ebfde1ae7082ed2a9863ff35ce.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_6314e207246318839093d72577ddf4fa.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_77644ab3c28bab4d4de2b75e4551371b.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_c7fa14eeffa1fc4e04b7b83c4cf99444.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edb4dc436c6453cd551d2af152ed26a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_0dac856da56b66e2bb136eff65f54f3f.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_7f5a9daba0782b13280c005f299981e4.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_9bbf0a8b1906ce1d019db475cd3a6e8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e7df6a0affa9c524aedbe249bf86eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_435a56ee650395cb728fbda8d71d30e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_086f03098b1ee138dfe421fff54a5007.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_4fd3e48614b8f1a35e8c990db6769819.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edf38a8388609e10b91abbdc78e23ae3.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_a9e7c5b4f728c63c5dc374d85155a8f7.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK11851> (referer: https://www.auto1.com/v1/car-details-view/TK11851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4f3d0>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_638db69c1e7fc95e541f564a25b0ed52.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007be10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_9d30cfad2821b383909c3dbb545a1dd7.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30300b10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_b2e98cf8bee34b5e16b87d35b4529d31.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_18c894af06f559acab3910e76745eaec.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_783206a8b89845f3c5c529317014e6e6.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_433dfe285e3da94e34c0bc0b5d744084.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_32851e861af050c41fc6d03cfc883d22.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_bbc8becb5570f4975b1863f9e8e5beba.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_9f43a500b1a7848c1cb658f568a7c784.jpg not downloaded yet
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb12d0>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017e010>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edb4dc436c6453cd551d2af152ed26a7.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e60d90>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_9bbf0a8b1906ce1d019db475cd3a6e8a.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017d550>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e7df6a0affa9c524aedbe249bf86eb.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1c810>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_435a56ee650395cb728fbda8d71d30e0.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with identifier: TK11851
2026-04-27 07:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with scrape type 1
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_cf861ff880c7e01949940b50e075980b.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_5b4bf4a2dc0ab33460a0e855b8289e3e.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_280f21f5fbf36d8fb8e7e728a18c4fe4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_ccf96883e6e65024002f7bda5bdd042f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_be1b3364988e74fb19c56dc681133869.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_d2f0b78b2d3a5b9bb1608c32e79f0fa5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_0ef3ba0d62c1869aa2a18e07fd7ed39a.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_a26917798e8808fd2fc5d3a84aedf0dc.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_78c7ac3c0973ca5897bd8ebbd4b404e7.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_4e7d4fd718ec23121d6b0fd969c35176.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_51e9cfc420cff0b3118bd9e5b1401baa.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_7384a21d07702c71d1fd21d038a19d86.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_f5dd7594a12a9f14def51b33a26542ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_cd8657dea8992b6d9f8469381877559a.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_1ef738de033aa7d6625f9e14becebcfa.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_8eaf8640aa591d1ca882625ff825e0c6.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_56700706cedd79efbed37bd4c8746485.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_be213bc59eb283095842d150fc0fc549.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017d390>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c03a50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_280f21f5fbf36d8fb8e7e728a18c4fe4.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cefb50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_ccf96883e6e65024002f7bda5bdd042f.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8d810>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_be1b3364988e74fb19c56dc681133869.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b63490>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_d2f0b78b2d3a5b9bb1608c32e79f0fa5.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_666e3165d20adbc2dbfcd3ecfa33b105.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_77644ab3c28bab4d4de2b75e4551371b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_85a9e29d73b4e67d01667bf7af781538.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_e349653c112a444152d3392ae348891e.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_bb76e0aae8448cbc46f34ff0f1e00982.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_c7fa14eeffa1fc4e04b7b83c4cf99444.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_6314e207246318839093d72577ddf4fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_2c833c6d81d6c1b33dd2f743699b7e44.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_929dcb0b6a6715dd9c1d72ab452fc4dd.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30178f50>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_f5dd7594a12a9f14def51b33a26542ea.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_7f5a9daba0782b13280c005f299981e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_9f43a500b1a7848c1cb658f568a7c784.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_cf861ff880c7e01949940b50e075980b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_d538ff250ced9a3b2fee713040866f72.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_118c3c340ab57c375259d578f662c014.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7d910>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_77644ab3c28bab4d4de2b75e4551371b.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d88d0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa6b90>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_bb76e0aae8448cbc46f34ff0f1e00982.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b80ed0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_c7fa14eeffa1fc4e04b7b83c4cf99444.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8590>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_6314e207246318839093d72577ddf4fa.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_8a2d824ec29ab9adba0ebd8ae553fd06.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_51e9cfc420cff0b3118bd9e5b1401baa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_32851e861af050c41fc6d03cfc883d22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e9d6ebfde1ae7082ed2a9863ff35ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_bbc8becb5570f4975b1863f9e8e5beba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_433dfe285e3da94e34c0bc0b5d744084.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce4250>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_7f5a9daba0782b13280c005f299981e4.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce1b90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_9f43a500b1a7848c1cb658f568a7c784.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a12c90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_cf861ff880c7e01949940b50e075980b.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_56700706cedd79efbed37bd4c8746485.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a10cd0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_51e9cfc420cff0b3118bd9e5b1401baa.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c03d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_32851e861af050c41fc6d03cfc883d22.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce9450>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e9d6ebfde1ae7082ed2a9863ff35ce.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fea610>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_bbc8becb5570f4975b1863f9e8e5beba.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce8a50>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_433dfe285e3da94e34c0bc0b5d744084.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_1ef738de033aa7d6625f9e14becebcfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_be213bc59eb283095842d150fc0fc549.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_8eaf8640aa591d1ca882625ff825e0c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_666e3165d20adbc2dbfcd3ecfa33b105.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64250>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_56700706cedd79efbed37bd4c8746485.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_929dcb0b6a6715dd9c1d72ab452fc4dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_847e4f0495242384cd83936479e65624.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_d538ff250ced9a3b2fee713040866f72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_2c833c6d81d6c1b33dd2f743699b7e44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_7c2eacf800ba073f1fdc14edddb5764d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_cf49102edabef7da91990b0e44df9b1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_e349653c112a444152d3392ae348891e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_cd8657dea8992b6d9f8469381877559a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_85a9e29d73b4e67d01667bf7af781538.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffadd0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_1ef738de033aa7d6625f9e14becebcfa.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca2a50>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_be213bc59eb283095842d150fc0fc549.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_8a2d824ec29ab9adba0ebd8ae553fd06.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_0ef3ba0d62c1869aa2a18e07fd7ed39a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d91310>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_8eaf8640aa591d1ca882625ff825e0c6.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e20210>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_666e3165d20adbc2dbfcd3ecfa33b105.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30059fd0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_929dcb0b6a6715dd9c1d72ab452fc4dd.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b88b90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_847e4f0495242384cd83936479e65624.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef8d90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_d538ff250ced9a3b2fee713040866f72.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75510>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_2c833c6d81d6c1b33dd2f743699b7e44.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e42850>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_7c2eacf800ba073f1fdc14edddb5764d.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41610>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_cf49102edabef7da91990b0e44df9b1f.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301417d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_e349653c112a444152d3392ae348891e.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_a26917798e8808fd2fc5d3a84aedf0dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004fad0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_cd8657dea8992b6d9f8469381877559a.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_118c3c340ab57c375259d578f662c014.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_4e7d4fd718ec23121d6b0fd969c35176.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_7384a21d07702c71d1fd21d038a19d86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_5b4bf4a2dc0ab33460a0e855b8289e3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_78c7ac3c0973ca5897bd8ebbd4b404e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b4d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_85a9e29d73b4e67d01667bf7af781538.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efb810>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_8a2d824ec29ab9adba0ebd8ae553fd06.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301eb4d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_0ef3ba0d62c1869aa2a18e07fd7ed39a.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_18c894af06f559acab3910e76745eaec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_783206a8b89845f3c5c529317014e6e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b76390>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_a26917798e8808fd2fc5d3a84aedf0dc.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdfe10>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_118c3c340ab57c375259d578f662c014.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb
2026-04-27 07:56:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb, skipping ID generation
2026-04-27 07:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with scrape type 1
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce38cd0d-31ec-5c69-bde1-01ff1920c0eb sending to next pipeline
2026-04-27 07:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb, identifier: TK11851
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32069550>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a57290>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_4e7d4fd718ec23121d6b0fd969c35176.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0b90>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_7384a21d07702c71d1fd21d038a19d86.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b625d0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_5b4bf4a2dc0ab33460a0e855b8289e3e.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6e8d0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_78c7ac3c0973ca5897bd8ebbd4b404e7.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_a9e7c5b4f728c63c5dc374d85155a8f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with identifier: TK11851
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-04-27 07:56:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with identifier: TK11851
2026-04-27 07:56:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce38cd0d-31ec-5c69-bde1-01ff1920c0eb with identifier: TK11851 to the API
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_118c3c340ab57c375259d578f662c014.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 306,
 'expiration_date': '2026-04-28T15:17:25Z',
 'fuel_type': 'hybrid',
 'id': 'ce38cd0d-31ec-5c69-bde1-01ff1920c0eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK11851',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 137599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_cf861ff880c7e01949940b50e075980b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_a26917798e8808fd2fc5d3a84aedf0dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_51e9cfc420cff0b3118bd9e5b1401baa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_1ef738de033aa7d6625f9e14becebcfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_be213bc59eb283095842d150fc0fc549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_e349653c112a444152d3392ae348891e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_929dcb0b6a6715dd9c1d72ab452fc4dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_d538ff250ced9a3b2fee713040866f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_118c3c340ab57c375259d578f662c014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce38cd0d-31ec-5c69-bde1-01ff1920c0eb/ce38cd0d-31ec-5c69-bde1-01ff1920c0eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/8b/8f8b16add66bfdd47d0faf8232fac6b9/pa/TK11851_8a2d824ec29ab9adba0ebd8ae553fd06.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-04-27 07:56:12 [auto1.de] INFO: Saving data for TK11851: {'created_time': 1777276572.992845, 'last_price_update_time': 1777276572.99286, 'has_photos': True, 'auction_closing_time': 1777389445.0}
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edf38a8388609e10b91abbdc78e23ae3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_086f03098b1ee138dfe421fff54a5007.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_4fd3e48614b8f1a35e8c990db6769819.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e61f50>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_18c894af06f559acab3910e76745eaec.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c138d0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_783206a8b89845f3c5c529317014e6e6.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_a9db7025fbb7dd3c93ec90d2d4290f03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4afaa150>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_a9e7c5b4f728c63c5dc374d85155a8f7.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebe5990>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edf38a8388609e10b91abbdc78e23ae3.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30063150>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdae90>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_086f03098b1ee138dfe421fff54a5007.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2a110>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_4fd3e48614b8f1a35e8c990db6769819.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_ef8e5f76c10e125257e8edf4c395a556.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_d416bc2bc63dd4fdcd99aed123ca204d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_340276fa1726fbbeaf98a4c7750dceaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016e190>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_a9db7025fbb7dd3c93ec90d2d4290f03.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce0efe84-2a89-5d91-a83b-2af72889f48d
2026-04-27 07:56:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce0efe84-2a89-5d91-a83b-2af72889f48d, skipping ID generation
2026-04-27 07:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0efe84-2a89-5d91-a83b-2af72889f48d with scrape type 1
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce0efe84-2a89-5d91-a83b-2af72889f48d sending to next pipeline
2026-04-27 07:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce0efe84-2a89-5d91-a83b-2af72889f48d, identifier: SE18089
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_afc5a182dd2358df8b5706368761f12a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce0efe84-2a89-5d91-a83b-2af72889f48d with identifier: SE18089
2026-04-27 07:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce0efe84-2a89-5d91-a83b-2af72889f48d with identifier: SE18089
2026-04-27 07:56:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce0efe84-2a89-5d91-a83b-2af72889f48d with identifier: SE18089 to the API
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_a9db7025fbb7dd3c93ec90d2d4290f03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'city': 'Überherrn',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:44:57Z',
 'fuel_type': 'diesel',
 'id': 'ce0efe84-2a89-5d91-a83b-2af72889f48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE18089',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 129113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_a9db7025fbb7dd3c93ec90d2d4290f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_7f5a9daba0782b13280c005f299981e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_18c894af06f559acab3910e76745eaec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_9f43a500b1a7848c1cb658f568a7c784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_0ef3ba0d62c1869aa2a18e07fd7ed39a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_4e7d4fd718ec23121d6b0fd969c35176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_cd8657dea8992b6d9f8469381877559a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_56700706cedd79efbed37bd4c8746485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_85a9e29d73b4e67d01667bf7af781538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce0efe84-2a89-5d91-a83b-2af72889f48d/ce0efe84-2a89-5d91-a83b-2af72889f48d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/9b/5c9b37841b36e420442d0474815d494a/pa/SE18089_2c833c6d81d6c1b33dd2f743699b7e44.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2018-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-04-27 07:56:13 [auto1.de] INFO: Saving data for SE18089: {'created_time': 1777276573.948334, 'last_price_update_time': 1777276573.948347, 'has_photos': True, 'auction_closing_time': 1777391097.0}
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_2e96877c2c7495b3727eff34dfc3247e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_2d6d0fed920a1147cda7bce7099f229b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_f73ce6d8697b53a282d3e91807e45003.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_7e81858a7e6cd1d41c607011099fa9c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c234d0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4c190>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_ef8e5f76c10e125257e8edf4c395a556.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c21ad0>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_d416bc2bc63dd4fdcd99aed123ca204d.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027aed0>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_340276fa1726fbbeaf98a4c7750dceaf.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce81d0>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_afc5a182dd2358df8b5706368761f12a.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_4d1b0cbd8ec1af8c513107d1ff3a2e63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ec9e10>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_2e96877c2c7495b3727eff34dfc3247e.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a13e90>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_2d6d0fed920a1147cda7bce7099f229b.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30194250>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a12610>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_f73ce6d8697b53a282d3e91807e45003.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729
2026-04-27 07:56:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e75d858-f9bb-5b21-b204-2ad75b7e9729, skipping ID generation
2026-04-27 07:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 1
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 sending to next pipeline
2026-04-27 07:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e75d858-f9bb-5b21-b204-2ad75b7e9729, identifier: YJ27680
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fee6d0>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_7e81858a7e6cd1d41c607011099fa9c9.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-04-27 07:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-04-27 07:56:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680 to the API
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_f73ce6d8697b53a282d3e91807e45003.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:43:20Z',
 'fuel_type': 'petrol',
 'id': '5e75d858-f9bb-5b21-b204-2ad75b7e9729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ27680',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 100742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_f73ce6d8697b53a282d3e91807e45003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_d416bc2bc63dd4fdcd99aed123ca204d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_c7fa14eeffa1fc4e04b7b83c4cf99444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_a9e7c5b4f728c63c5dc374d85155a8f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_bbc8becb5570f4975b1863f9e8e5beba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_5b4bf4a2dc0ab33460a0e855b8289e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_78c7ac3c0973ca5897bd8ebbd4b404e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_7384a21d07702c71d1fd21d038a19d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_8eaf8640aa591d1ca882625ff825e0c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5e75d858-f9bb-5b21-b204-2ad75b7e9729/5e75d858-f9bb-5b21-b204-2ad75b7e9729_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fe10453fc30ec689cf262aeac7518/pa/YJ27680_666e3165d20adbc2dbfcd3ecfa33b105.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-04-27 07:56:15 [auto1.de] INFO: Saving data for YJ27680: {'created_time': 1777276575.008025, 'last_price_update_time': 1777276575.008034, 'has_photos': True, 'auction_closing_time': 1777391000.0}
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_5d8da778e9e150faf2bd6bc4efc2b322.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_b8fef278e9a59277cff383ee5870fc53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_70b70bf59b6430684972e85f4c6d67e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_afa208de2a36e5fff61eac886c415c6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_a8a233a0fdfa3ca99455efc69af0c26a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d35fbbbd0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f68ad0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_4d1b0cbd8ec1af8c513107d1ff3a2e63.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_85e798d0cebfc5240fcb9ac381fcfef9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_bde1fadd2559d945d5c2fc822e0216d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_0dac856da56b66e2bb136eff65f54f3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd2f90>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_5d8da778e9e150faf2bd6bc4efc2b322.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_95fe85cbe372740f4f75507dcf4c245c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efbc10>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_b8fef278e9a59277cff383ee5870fc53.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97b89220-43c1-56a8-ba77-6b38e7b44637
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97b89220-43c1-56a8-ba77-6b38e7b44637, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b89220-43c1-56a8-ba77-6b38e7b44637 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97b89220-43c1-56a8-ba77-6b38e7b44637 sending to next pipeline
2026-04-27 07:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97b89220-43c1-56a8-ba77-6b38e7b44637, identifier: WJ84209
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bf2750>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_70b70bf59b6430684972e85f4c6d67e8.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d35fbbfd0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_afa208de2a36e5fff61eac886c415c6d.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43010>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_a8a233a0fdfa3ca99455efc69af0c26a.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f764d0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97b89220-43c1-56a8-ba77-6b38e7b44637 with identifier: WJ84209
2026-04-27 07:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97b89220-43c1-56a8-ba77-6b38e7b44637 with identifier: WJ84209
2026-04-27 07:56:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97b89220-43c1-56a8-ba77-6b38e7b44637 with identifier: WJ84209 to the API
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_b8fef278e9a59277cff383ee5870fc53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Schkopau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:01:37Z',
 'fuel_type': 'petrol',
 'id': '97b89220-43c1-56a8-ba77-6b38e7b44637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ84209',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 119917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_638db69c1e7fc95e541f564a25b0ed52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_b8fef278e9a59277cff383ee5870fc53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edb4dc436c6453cd551d2af152ed26a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_f5dd7594a12a9f14def51b33a26542ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_435a56ee650395cb728fbda8d71d30e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_2d6d0fed920a1147cda7bce7099f229b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_ef8e5f76c10e125257e8edf4c395a556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_77644ab3c28bab4d4de2b75e4551371b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_edf38a8388609e10b91abbdc78e23ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97b89220-43c1-56a8-ba77-6b38e7b44637/97b89220-43c1-56a8-ba77-6b38e7b44637_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/05/4005be57de7a889a3707b5484f081949/pa/WJ84209_32851e861af050c41fc6d03cfc883d22.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2014-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2014}
2026-04-27 07:56:15 [auto1.de] INFO: Saving data for WJ84209: {'created_time': 1777276575.866531, 'last_price_update_time': 1777276575.866542, 'has_photos': True, 'auction_closing_time': 1777388497.0}
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_1ac49bbad91919d75b9d7ac74d858c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_e892bd9e98256dff32eacfec66fd3722.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_df1547b0249633d62b112198f0e042b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_b8c22300879e2ea094ce1a9dfef1b940.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_f3c124ca3c321e3f4e5aa47e313a279e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_a90dfa39cacc865a81c3305943c7bf3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_25f86af11f33addaa37e297e579435d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9490>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_85e798d0cebfc5240fcb9ac381fcfef9.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aea411f7-b03a-5459-845c-5091a8219192
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aea411f7-b03a-5459-845c-5091a8219192, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aea411f7-b03a-5459-845c-5091a8219192 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aea411f7-b03a-5459-845c-5091a8219192 sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aea411f7-b03a-5459-845c-5091a8219192, identifier: VN99537
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b84ed0>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54a8d50-57a9-5560-8e0b-7c12214f2c1f, skipping ID generation
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a54a8d50-57a9-5560-8e0b-7c12214f2c1f, identifier: KV10415
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce66d0>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_bde1fadd2559d945d5c2fc822e0216d7.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc9450>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_0dac856da56b66e2bb136eff65f54f3f.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f883b1f6-5b5d-501e-bdb8-880d235310e0
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f883b1f6-5b5d-501e-bdb8-880d235310e0, skipping ID generation
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f883b1f6-5b5d-501e-bdb8-880d235310e0 with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f883b1f6-5b5d-501e-bdb8-880d235310e0 sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f883b1f6-5b5d-501e-bdb8-880d235310e0, identifier: VD40103
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300afd90>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_95fe85cbe372740f4f75507dcf4c245c.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_ee311b33da7c865e7a33d622abe31881.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aea411f7-b03a-5459-845c-5091a8219192 with identifier: VN99537
2026-04-27 07:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aea411f7-b03a-5459-845c-5091a8219192 with identifier: VN99537
2026-04-27 07:56:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aea411f7-b03a-5459-845c-5091a8219192 with identifier: VN99537 to the API
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_85e798d0cebfc5240fcb9ac381fcfef9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'city': 'Kerpen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:44:11Z',
 'fuel_type': 'petrol',
 'id': 'aea411f7-b03a-5459-845c-5091a8219192',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN99537',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 61559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_85e798d0cebfc5240fcb9ac381fcfef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_a8a233a0fdfa3ca99455efc69af0c26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_9bbf0a8b1906ce1d019db475cd3a6e8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_bb76e0aae8448cbc46f34ff0f1e00982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_ccf96883e6e65024002f7bda5bdd042f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_7e81858a7e6cd1d41c607011099fa9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_afc5a182dd2358df8b5706368761f12a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_6314e207246318839093d72577ddf4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_4fd3e48614b8f1a35e8c990db6769819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aea411f7-b03a-5459-845c-5091a8219192/aea411f7-b03a-5459-845c-5091a8219192_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/a8/49a8d817a87f9bc8846a7f598502e121/pa/VN99537_433dfe285e3da94e34c0bc0b5d744084.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2016}
2026-04-27 07:56:16 [auto1.de] INFO: Saving data for VN99537: {'created_time': 1777276576.859109, 'last_price_update_time': 1777276576.85912, 'has_photos': True, 'auction_closing_time': 1777391051.0}
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-04-27 07:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-04-27 07:56:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415 to the API
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 252,
 'category': None,
 'city': 'Mainz',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '4.2L',
 'engine_horse_power': 450,
 'expiration_date': '2026-04-28T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'a54a8d50-57a9-5560-8e0b-7c12214f2c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.001,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV10415',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'location_confidence': 'geocoded',
 'longitude': 8.2688,
 'make': 'Audi',
 'model': 'RS 5',
 'odometer': 110580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg',
             'Width': 800}],
 'postal_code': '55116',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2010-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi RS 5 4.2 V8 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-04-27 07:56:17 [auto1.de] INFO: Saving data for KV10415: {'created_time': 1777276577.242183, 'last_price_update_time': 1777276577.242199, 'has_photos': True, 'auction_closing_time': 1777391290.0}
2026-04-27 07:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f883b1f6-5b5d-501e-bdb8-880d235310e0 with identifier: VD40103
2026-04-27 07:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f883b1f6-5b5d-501e-bdb8-880d235310e0 with identifier: VD40103
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f883b1f6-5b5d-501e-bdb8-880d235310e0 with identifier: VD40103 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_0dac856da56b66e2bb136eff65f54f3f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'city': 'Dormagen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 330,
 'expiration_date': '2026-04-28T15:51:47Z',
 'fuel_type': 'petrol',
 'id': 'f883b1f6-5b5d-501e-bdb8-880d235310e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.0964,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD40103',
 'listing': 'auction',
 'location': 'DE, Dormagen',
 'location_confidence': 'geocoded',
 'longitude': 6.84,
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 138992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_847e4f0495242384cd83936479e65624.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_b2e98cf8bee34b5e16b87d35b4529d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_9d30cfad2821b383909c3dbb545a1dd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_7c2eacf800ba073f1fdc14edddb5764d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_cf49102edabef7da91990b0e44df9b1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_d2f0b78b2d3a5b9bb1608c32e79f0fa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_be1b3364988e74fb19c56dc681133869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_2e96877c2c7495b3727eff34dfc3247e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_bde1fadd2559d945d5c2fc822e0216d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f883b1f6-5b5d-501e-bdb8-880d235310e0/f883b1f6-5b5d-501e-bdb8-880d235310e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3077558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/88/df8864684c6909a85b5ff8362d2d6421/pa/VD40103_0dac856da56b66e2bb136eff65f54f3f.jpg',
             'Width': 2048}],
 'postal_code': '41539',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Düsseldorf',
 'province_code': 'DE-051',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-05-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Panamera 4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-04-27 07:56:17 [auto1.de] INFO: Saving data for VD40103: {'created_time': 1777276577.756338, 'last_price_update_time': 1777276577.756351, 'has_photos': True, 'auction_closing_time': 1777391507.0}
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_d8265f2698a35ea7a79f124904b9abcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD88399> (referer: https://www.auto1.com/v1/car-details-view/KD88399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b28ad0>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_1ac49bbad91919d75b9d7ac74d858c1b.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a46e50>
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_e892bd9e98256dff32eacfec66fd3722.jpg saved to cache
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be3e642c-a2bf-5ae2-9bf5-274759b71517
2026-04-27 07:56:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be3e642c-a2bf-5ae2-9bf5-274759b71517, skipping ID generation
2026-04-27 07:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 1
2026-04-27 07:56:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be3e642c-a2bf-5ae2-9bf5-274759b71517 sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be3e642c-a2bf-5ae2-9bf5-274759b71517, identifier: FH83727
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f2c90>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_df1547b0249633d62b112198f0e042b4.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44514486-a14f-55c0-b3aa-ba2df99a69a3
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44514486-a14f-55c0-b3aa-ba2df99a69a3, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44514486-a14f-55c0-b3aa-ba2df99a69a3 with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44514486-a14f-55c0-b3aa-ba2df99a69a3 sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44514486-a14f-55c0-b3aa-ba2df99a69a3, identifier: WR24520
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a47390>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_b8c22300879e2ea094ce1a9dfef1b940.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cebc90>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_f3c124ca3c321e3f4e5aa47e313a279e.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a463d0>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_a90dfa39cacc865a81c3305943c7bf3e.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dcbd0>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_25f86af11f33addaa37e297e579435d1.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25, identifier: MM42561
2026-04-27 07:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_834cfc3680cf6b52ba00ea5581f885d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_8346e25438bf43cd0b1c70d90fbbfed7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-04-27 07:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-04-27 07:56:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727 to the API
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_e892bd9e98256dff32eacfec66fd3722.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'city': 'Buch',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:12:12Z',
 'fuel_type': 'diesel',
 'id': 'be3e642c-a2bf-5ae2-9bf5-274759b71517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH83727',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 29035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_95fe85cbe372740f4f75507dcf4c245c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_e892bd9e98256dff32eacfec66fd3722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e7df6a0affa9c524aedbe249bf86eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_5d8da778e9e150faf2bd6bc4efc2b322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_280f21f5fbf36d8fb8e7e728a18c4fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_4d1b0cbd8ec1af8c513107d1ff3a2e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_340276fa1726fbbeaf98a4c7750dceaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_93e9d6ebfde1ae7082ed2a9863ff35ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_086f03098b1ee138dfe421fff54a5007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_be3e642c-a2bf-5ae2-9bf5-274759b71517/be3e642c-a2bf-5ae2-9bf5-274759b71517_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/a5/c9a59ee747d67e44e5db8f9b6988dede/pa/FH83727_783206a8b89845f3c5c529317014e6e6.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2019-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-04-27 07:56:18 [auto1.de] INFO: Saving data for FH83727: {'created_time': 1777276578.865776, 'last_price_update_time': 1777276578.865788, 'has_photos': True, 'auction_closing_time': 1777389132.0}
2026-04-27 07:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44514486-a14f-55c0-b3aa-ba2df99a69a3 with identifier: WR24520
2026-04-27 07:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44514486-a14f-55c0-b3aa-ba2df99a69a3 with identifier: WR24520
2026-04-27 07:56:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44514486-a14f-55c0-b3aa-ba2df99a69a3 with identifier: WR24520 to the API
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_df1547b0249633d62b112198f0e042b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Ellerau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:41:13Z',
 'fuel_type': 'diesel',
 'id': '44514486-a14f-55c0-b3aa-ba2df99a69a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR24520',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 152570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f5dde38ee7da3c5223f2e138e267b5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_73963057e49c133f31490fc4aac08940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_92a6a3c3fa49fcacef1df45e01b380c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_f47bd94230c44a85aa23caa94932d827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_e927ba138b2d49cefdecc3e1f76a99d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_95192b3bcd0920841d361893bef058cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_1ac49bbad91919d75b9d7ac74d858c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_df1547b0249633d62b112198f0e042b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_afa208de2a36e5fff61eac886c415c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_44514486-a14f-55c0-b3aa-ba2df99a69a3/44514486-a14f-55c0-b3aa-ba2df99a69a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/38/5b38474dddf3c1b8cd2f1dff9be19988/pa/WR24520_70b70bf59b6430684972e85f4c6d67e8.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-04-27 07:56:19 [auto1.de] INFO: Saving data for WR24520: {'created_time': 1777276579.266879, 'last_price_update_time': 1777276579.266888, 'has_photos': True, 'auction_closing_time': 1777390873.0}
2026-04-27 07:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with identifier: MM42561
2026-04-27 07:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with identifier: MM42561
2026-04-27 07:56:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74808ad3-6485-5e55-bd7f-7d5bd90bcd25 with identifier: MM42561 to the API
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_25f86af11f33addaa37e297e579435d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Hattingen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:01:29Z',
 'fuel_type': 'petrol',
 'id': '74808ad3-6485-5e55-bd7f-7d5bd90bcd25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM42561',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 119545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_bafdc90a38a5c08544e4b2b4fa859903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_7a49cae514f0336366236a98b52a3944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_301c9251f2139cf406ef4870f205669d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_0a3a6d5a43baf47dacb4a23c07066d53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_f4b9014982f6a127e85dfe9832c717fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_cbd47a6366be7eeb06359281e08b03cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_25f86af11f33addaa37e297e579435d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_8f68c2b37a643f0ac44e428c2cfeb81b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_a90dfa39cacc865a81c3305943c7bf3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_74808ad3-6485-5e55-bd7f-7d5bd90bcd25/74808ad3-6485-5e55-bd7f-7d5bd90bcd25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/42/4942ac6329f3ba33290638644ce9947b/pa/MM42561_b8c22300879e2ea094ce1a9dfef1b940.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2015-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2015}
2026-04-27 07:56:19 [auto1.de] INFO: Saving data for MM42561: {'created_time': 1777276579.689164, 'last_price_update_time': 1777276579.689175, 'has_photos': True, 'auction_closing_time': 1777388489.0}
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_5edfd0ccd0a59199e95c1c7ef56e74e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014ec50>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_ee311b33da7c865e7a33d622abe31881.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003a310>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_d8265f2698a35ea7a79f124904b9abcb.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd612883-323e-5925-b065-c6b44120f499
2026-04-27 07:56:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd612883-323e-5925-b065-c6b44120f499, skipping ID generation
2026-04-27 07:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd612883-323e-5925-b065-c6b44120f499 with scrape type 1
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd612883-323e-5925-b065-c6b44120f499 sending to next pipeline
2026-04-27 07:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd612883-323e-5925-b065-c6b44120f499, identifier: AR78319
2026-04-27 07:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3cfbce-f0b1-51de-8717-70028c986fdb with identifier: KD88399
2026-04-27 07:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3cfbce-f0b1-51de-8717-70028c986fdb with scrape type 1
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_2835154ac6489cf3cd5b5cf323f22d19.jpg not downloaded yet
2026-04-27 07:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd612883-323e-5925-b065-c6b44120f499 with identifier: AR78319
2026-04-27 07:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd612883-323e-5925-b065-c6b44120f499 with identifier: AR78319
2026-04-27 07:56:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd612883-323e-5925-b065-c6b44120f499 with identifier: AR78319 to the API
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_d8265f2698a35ea7a79f124904b9abcb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Northeim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:14:32Z',
 'fuel_type': 'diesel',
 'id': 'fd612883-323e-5925-b065-c6b44120f499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.7066,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR78319',
 'listing': 'auction',
 'location': 'DE, Northeim',
 'location_confidence': 'geocoded',
 'longitude': 10.0,
 'make': 'Toyota',
 'model': 'ProAce City Verso',
 'odometer': 68849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_6e3603329f2f1579e0e9288722bc7467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_475b5e5fdf8f09f37a8b87d744bbb4fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_83fdae95c094b0c132ffb04e7e42b802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_e8d44126fa22ab8e038679e71cccd33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_d8265f2698a35ea7a79f124904b9abcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_01e86168402ad31c7ef318f1b1d2d451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_bcc21fed365d6607327d69e08861ede6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_a4f0ff3b58f87e87e21b99cdcea5c447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_9e7c02f2f5789958c43ab176206a2816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd612883-323e-5925-b065-c6b44120f499/fd612883-323e-5925-b065-c6b44120f499_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/61/546124eb97d816e11699e10b7fa974c6/pa/AR78319_f3c124ca3c321e3f4e5aa47e313a279e.jpg',
             'Width': 800}],
 'postal_code': '37154',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota ProAce City Verso 1.5 D-4D L1 Team D',
 'transmission': 'manual',
 'trim': 'L1 Team D',
 'year': 2021}
2026-04-27 07:56:20 [auto1.de] INFO: Saving data for AR78319: {'created_time': 1777276580.328592, 'last_price_update_time': 1777276580.328606, 'has_photos': True, 'auction_closing_time': 1777389272.0}
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e85512ad0d432b667d31216e8eaa4b69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_ad45dfffe8e8340c30b58661b40264cd.jpg not downloaded yet
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcd450>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_834cfc3680cf6b52ba00ea5581f885d3.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e085d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_8346e25438bf43cd0b1c70d90fbbfed7.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_fc4bb7d7da627f4896a81cd876db32cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_8a0c6b6e04863a0572ccaf80f67e4e33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_09595fd3845e1f21853ada63405c8909.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_0c4b7d7d632c56915001b748e40e0ec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_b15d7e2e53cec6de1240d4fb02c671b3.jpg not downloaded yet
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9f10>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_5edfd0ccd0a59199e95c1c7ef56e74e9.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e5f46222cb6031871850a7a826b777ce.jpg not downloaded yet
2026-04-27 07:56:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca1710>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e85512ad0d432b667d31216e8eaa4b69.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60771452-6393-52f9-a8a1-8a5724ca4e9f
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60771452-6393-52f9-a8a1-8a5724ca4e9f, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60771452-6393-52f9-a8a1-8a5724ca4e9f with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60771452-6393-52f9-a8a1-8a5724ca4e9f sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60771452-6393-52f9-a8a1-8a5724ca4e9f, identifier: VA67645
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bf6d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cf233600f5e3a0b1ebe862c805ee3e2b.jpg not downloaded yet
2026-04-27 07:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60771452-6393-52f9-a8a1-8a5724ca4e9f with identifier: VA67645
2026-04-27 07:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60771452-6393-52f9-a8a1-8a5724ca4e9f with identifier: VA67645
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60771452-6393-52f9-a8a1-8a5724ca4e9f with identifier: VA67645 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e85512ad0d432b667d31216e8eaa4b69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'city': 'Berlin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:31:37Z',
 'fuel_type': 'diesel',
 'id': '60771452-6393-52f9-a8a1-8a5724ca4e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.5323,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA67645',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'location_confidence': 'geocoded',
 'longitude': 13.3846,
 'make': 'Volkswagen',
 'model': 'T5 California',
 'odometer': 167384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369543,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_2b657456ecde418b4b4e26f609234e6c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390803,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e886155579513344466a9ed53daff1de.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358183,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e85512ad0d432b667d31216e8eaa4b69.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_8346e25438bf43cd0b1c70d90fbbfed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272723,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_5edfd0ccd0a59199e95c1c7ef56e74e9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343410,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_e22ad261355f80902b294ded2cac5f46.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_b2cf2f1bc239a84a3856295f92a928f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378537,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_48136f05e1cb06da43c8624b7ef299b8.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361802,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_244a376b6dbc6f710bc4ec2f3cec5ca4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60771452-6393-52f9-a8a1-8a5724ca4e9f/60771452-6393-52f9-a8a1-8a5724ca4e9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307990,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/73/d773add8a8742228492f0ccf12c8c949/pa/VA67645_ee311b33da7c865e7a33d622abe31881.jpg',
             'Width': 1200}],
 'postal_code': '10115',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Berlin',
 'region_code': 'DE-BE',
 'registration_date': '2012-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T5 California 2.0 TDI Beach Aufstelldach',
 'transmission': 'manual',
 'trim': 'Beach Aufstelldach',
 'year': 2012}
2026-04-27 07:56:21 [auto1.de] INFO: Saving data for VA67645: {'created_time': 1777276581.297939, 'last_price_update_time': 1777276581.297948, 'has_photos': True, 'auction_closing_time': 1777390297.0}
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_760c3dfc935b97aed779186f64bba832.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_703366e89adc0306a74fec1ac4b09843.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_4d704a5ad4d088bf1c7f06d8b4f3c61b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_2835154ac6489cf3cd5b5cf323f22d19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_254ce7635146ce862913d275b697eef7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_56ed6229ecebb2a4ba38517fbe326263.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_98f79484e3c3d33fe0560d0642163e36.jpg not downloaded yet
2026-04-27 07:56:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d50110>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_fc4bb7d7da627f4896a81cd876db32cb.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2dd0>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fec350>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_8a0c6b6e04863a0572ccaf80f67e4e33.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b89b50>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_09595fd3845e1f21853ada63405c8909.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e42dd0>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f771d0>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_0c4b7d7d632c56915001b748e40e0ec3.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43310>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_9684b643326c0c9378504bea45d93cfc.jpg not downloaded yet
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fce910>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_760c3dfc935b97aed779186f64bba832.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b66d0>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_703366e89adc0306a74fec1ac4b09843.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b89e90>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_4d704a5ad4d088bf1c7f06d8b4f3c61b.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b
2026-04-27 07:56:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68f38dbe-d798-5fc7-a1f4-ab657971b48b, skipping ID generation
2026-04-27 07:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b with scrape type 1
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68f38dbe-d798-5fc7-a1f4-ab657971b48b sending to next pipeline
2026-04-27 07:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68f38dbe-d798-5fc7-a1f4-ab657971b48b, identifier: CG22932
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f72990>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_2835154ac6489cf3cd5b5cf323f22d19.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d50110>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg saved to cache
2026-04-27 07:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff8e50>
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_254ce7635146ce862913d275b697eef7.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b10850>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179f90>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_56ed6229ecebb2a4ba38517fbe326263.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e5f46222cb6031871850a7a826b777ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e41503fc587828ac6a7d116e4b262b8e.jpg not downloaded yet
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68f38dbe-d798-5fc7-a1f4-ab657971b48b with identifier: CG22932
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68f38dbe-d798-5fc7-a1f4-ab657971b48b with identifier: CG22932
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68f38dbe-d798-5fc7-a1f4-ab657971b48b with identifier: CG22932 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_4d704a5ad4d088bf1c7f06d8b4f3c61b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:29:19Z',
 'fuel_type': 'petrol',
 'id': '68f38dbe-d798-5fc7-a1f4-ab657971b48b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG22932',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': '1er',
 'odometer': 157169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_4d704a5ad4d088bf1c7f06d8b4f3c61b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_e28d68725854ed16bba5f8d614dda968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_5bde2bc6fd126e69a91acdee54e08223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_6fbd132afaac9072443dca7609881809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_87940000d35e282c951df32d63a502a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_f4d14662ec24e3925336b9e5e2720b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_b5a66ab1b2cac6d1635196b7115ef304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_fc4bb7d7da627f4896a81cd876db32cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_2581ded0252477a208eccd92714d1682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68f38dbe-d798-5fc7-a1f4-ab657971b48b/68f38dbe-d798-5fc7-a1f4-ab657971b48b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8e6f4355be4bda7f2455313dda4f6c/pa/CG22932_834cfc3680cf6b52ba00ea5581f885d3.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2012-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-04-27 07:56:22 [auto1.de] INFO: Saving data for CG22932: {'created_time': 1777276582.550548, 'last_price_update_time': 1777276582.550564, 'has_photos': True, 'auction_closing_time': 1777390159.0}
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_b15d7e2e53cec6de1240d4fb02c671b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_223d1854c30874d5ca5d790250f34d23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_c597f8e6b129779b6bbdb68760bb01f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cf233600f5e3a0b1ebe862c805ee3e2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_ad45dfffe8e8340c30b58661b40264cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_0444cb6b2b2c3ced32470aa21005a925.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_c47ca729af77248b2e3af83579b7bf2e.jpg not downloaded yet
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS17247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9f9d0>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e5f46222cb6031871850a7a826b777ce.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cbe4b45d82555a1f6f89fc0bc6724114.jpg not downloaded yet
2026-04-27 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM47084> (referer: https://www.auto1.com/v1/car-details-view/JM47084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6d510>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_b15d7e2e53cec6de1240d4fb02c671b3.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300caf10>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10002550-1074-57c4-9820-62c0ff499daa
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10002550-1074-57c4-9820-62c0ff499daa, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10002550-1074-57c4-9820-62c0ff499daa with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10002550-1074-57c4-9820-62c0ff499daa sending to next pipeline
2026-04-27 07:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10002550-1074-57c4-9820-62c0ff499daa, identifier: ND23678
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301aa290>
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_223d1854c30874d5ca5d790250f34d23.jpg saved to cache
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 349b638f-de95-5200-9efe-8f0b8c30ef07
2026-04-27 07:56:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 349b638f-de95-5200-9efe-8f0b8c30ef07, skipping ID generation
2026-04-27 07:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349b638f-de95-5200-9efe-8f0b8c30ef07 with scrape type 1
2026-04-27 07:56:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 349b638f-de95-5200-9efe-8f0b8c30ef07 sending to next pipeline
2026-04-27 07:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 349b638f-de95-5200-9efe-8f0b8c30ef07, identifier: YL95157
2026-04-27 07:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-04-27 07:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678
2026-04-27 07:56:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10002550-1074-57c4-9820-62c0ff499daa with identifier: ND23678 to the API
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'city': 'Kippenheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-04-28T15:07:09Z',
 'fuel_type': 'diesel',
 'id': '10002550-1074-57c4-9820-62c0ff499daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND23678',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 182799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_19f9ff7595b4f327d68627a03abe1726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_e9adb6f0483def104b4607d3083f6f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b0e83771d423e01e00f443a9bd944f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_bc9caa46a699e8c600188ec0597c7716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_204a4e1aa80ffdcae2fce98251ebae66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_469aa84c86b753db4869659fbf76bbf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_41e245b39318ff30775e07ba757630b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_8e4b43f317ccd5e1376a01417eb2bad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_48eedf517b49fc46da969f991fcfb9bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10002550-1074-57c4-9820-62c0ff499daa/10002550-1074-57c4-9820-62c0ff499daa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/d2/35d2865612278624f003633e2f1750f9/pa/ND23678_b38013e89de2cacd0ec93c4ac66ec148.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2019-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 SD V6 SE R-Dynamic',
 'transmission': 'automatic',
 'trim': 'SE R-Dynamic',
 'year': 2019}
2026-04-27 07:56:23 [auto1.de] INFO: Saving data for ND23678: {'created_time': 1777276583.589444, 'last_price_update_time': 1777276583.589453, 'has_photos': True, 'auction_closing_time': 1777388829.0}
2026-04-27 07:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 349b638f-de95-5200-9efe-8f0b8c30ef07 with identifier: YL95157
2026-04-27 07:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 349b638f-de95-5200-9efe-8f0b8c30ef07 with identifier: YL95157
2026-04-27 07:56:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 349b638f-de95-5200-9efe-8f0b8c30ef07 with identifier: YL95157 to the API
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_223d1854c30874d5ca5d790250f34d23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': 'Rental',
 'city': 'Ludwigsburg',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:59:17Z',
 'fuel_type': 'petrol',
 'id': '349b638f-de95-5200-9efe-8f0b8c30ef07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.9076,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL95157',
 'listing': 'auction',
 'location': 'DE, Ludwigsburg',
 'location_confidence': 'geocoded',
 'longitude': 9.1776,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 152506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_223d1854c30874d5ca5d790250f34d23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_254ce7635146ce862913d275b697eef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_703366e89adc0306a74fec1ac4b09843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_56ed6229ecebb2a4ba38517fbe326263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_b4144fc10f98a4788e4f2ddafb59eb71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_daa19f6945ada7596c6f45591ad6a1d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_760c3dfc935b97aed779186f64bba832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_0c4b7d7d632c56915001b748e40e0ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_09595fd3845e1f21853ada63405c8909.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_349b638f-de95-5200-9efe-8f0b8c30ef07/349b638f-de95-5200-9efe-8f0b8c30ef07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ea/3dea06e7fb4c151851bc570ed9850235/pa/YL95157_8a0c6b6e04863a0572ccaf80f67e4e33.jpg',
             'Width': 800}],
 'postal_code': '71634',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Stuttgart',
 'province_code': 'DE-081',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2015-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Exklusiv',
 'transmission': 'automatic',
 'trim': 'Exklusiv',
 'year': 2015}
2026-04-27 07:56:24 [auto1.de] INFO: Saving data for YL95157: {'created_time': 1777276584.061959, 'last_price_update_time': 1777276584.061974, 'has_photos': True, 'auction_closing_time': 1777391957.0}
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_9684b643326c0c9378504bea45d93cfc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e41503fc587828ac6a7d116e4b262b8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_98f79484e3c3d33fe0560d0642163e36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_1af0c2947154ff9afa03eb45a5ab52d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_878ea48a3fd96d1fb9582c82afaa6e30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b13290>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_c597f8e6b129779b6bbdb68760bb01f3.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f87910>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cf233600f5e3a0b1ebe862c805ee3e2b.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b589d0>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_ad45dfffe8e8340c30b58661b40264cd.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb5390>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_0444cb6b2b2c3ced32470aa21005a925.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with identifier: JM47084
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_33fa8a7e4023a37f24ddcf296ce3c886.jpg not downloaded yet
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV45704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN42898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB76592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN60683> (referer: https://www.auto1.com/v1/car-details-view/CN60683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_f83352a5df484ab7d717c71eec93b8c7.jpg not downloaded yet
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cbe4b45d82555a1f6f89fc0bc6724114.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP15031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d93f10>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_9684b643326c0c9378504bea45d93cfc.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82990>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e41503fc587828ac6a7d116e4b262b8e.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dac590>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_98f79484e3c3d33fe0560d0642163e36.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d53ed0>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_1af0c2947154ff9afa03eb45a5ab52d4.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6e550>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_878ea48a3fd96d1fb9582c82afaa6e30.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_ccffebe9c08489d7de4a20bbef36119d.jpg not downloaded yet
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_a479825d1970ef1b1573bee79de1a246.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_c47ca729af77248b2e3af83579b7bf2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_aee087496443adb864d8f9c831d5139c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_c2361c0a3ee23bb66d0465b177a215d1.jpg not downloaded yet
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_cd985b5d25380159976394204fa1b305.jpg not downloaded yet
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017d090>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cbe4b45d82555a1f6f89fc0bc6724114.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_33fa8a7e4023a37f24ddcf296ce3c886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_1828c5bc29baded318e3dbd063b453aa.jpg not downloaded yet
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_bdde321407e0617465e2c6087965eacb.jpg not downloaded yet
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_f83352a5df484ab7d717c71eec93b8c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_9b408de4b423d27c2c920e3edf366e6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_9cd193a2b888772441bae156275b9835.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_543be940df4e436172bbd44aab30d92f.jpg not downloaded yet
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30278f90>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_a479825d1970ef1b1573bee79de1a246.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165810>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_c47ca729af77248b2e3af83579b7bf2e.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af3cfbce-f0b1-51de-8717-70028c986fdb
2026-04-27 07:56:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af3cfbce-f0b1-51de-8717-70028c986fdb, skipping ID generation
2026-04-27 07:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3cfbce-f0b1-51de-8717-70028c986fdb with scrape type 1
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af3cfbce-f0b1-51de-8717-70028c986fdb sending to next pipeline
2026-04-27 07:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af3cfbce-f0b1-51de-8717-70028c986fdb, identifier: KD88399
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c2650>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_aee087496443adb864d8f9c831d5139c.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af3cfbce-f0b1-51de-8717-70028c986fdb with identifier: KD88399
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af3cfbce-f0b1-51de-8717-70028c986fdb with identifier: KD88399
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af3cfbce-f0b1-51de-8717-70028c986fdb with identifier: KD88399 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_c47ca729af77248b2e3af83579b7bf2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 274,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 325,
 'expiration_date': '2026-04-28T15:21:59Z',
 'fuel_type': 'petrol',
 'id': 'af3cfbce-f0b1-51de-8717-70028c986fdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD88399',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 157102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_2835154ac6489cf3cd5b5cf323f22d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_ad45dfffe8e8340c30b58661b40264cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_b15d7e2e53cec6de1240d4fb02c671b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e5f46222cb6031871850a7a826b777ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cf233600f5e3a0b1ebe862c805ee3e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_98f79484e3c3d33fe0560d0642163e36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_9684b643326c0c9378504bea45d93cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_e41503fc587828ac6a7d116e4b262b8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_c47ca729af77248b2e3af83579b7bf2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af3cfbce-f0b1-51de-8717-70028c986fdb/af3cfbce-f0b1-51de-8717-70028c986fdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/c6/46c67d6bb25dd18c4a1ec0cac141d952/pa/KD88399_cbe4b45d82555a1f6f89fc0bc6724114.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2010-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo OPC 4x4',
 'transmission': 'manual',
 'trim': 'OPC 4x4',
 'year': 2010}
2026-04-27 07:56:25 [auto1.de] INFO: Saving data for KD88399: {'created_time': 1777276585.665116, 'last_price_update_time': 1777276585.665126, 'has_photos': True, 'auction_closing_time': 1777389719.0}
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_71a4e8deb758824f01b6e1ffffff73d8.jpg not downloaded yet
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_cc4fafb67dd8ff6b6608ff992d0d3cd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_ccffebe9c08489d7de4a20bbef36119d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA32853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a704d0>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_33fa8a7e4023a37f24ddcf296ce3c886.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302aa410>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_f83352a5df484ab7d717c71eec93b8c7.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32089e50>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_9b408de4b423d27c2c920e3edf366e6c.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30140210>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_9cd193a2b888772441bae156275b9835.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_1828c5bc29baded318e3dbd063b453aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_c9d305b8c902a72cb499eeadbda6b24e.jpg not downloaded yet
2026-04-27 07:56:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY44353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_bdde321407e0617465e2c6087965eacb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_cd985b5d25380159976394204fa1b305.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_ca74cd84fd135b13e702a71b1b91f4a1.jpg not downloaded yet
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d51990>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_cc4fafb67dd8ff6b6608ff992d0d3cd5.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bf490>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_ccffebe9c08489d7de4a20bbef36119d.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_2e78c0e71b5b601e750a5a27b5e90645.jpg not downloaded yet
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_f66c58b2366ee14cf65f19d6cf3b35c6.jpg not downloaded yet
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011ed50>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_1828c5bc29baded318e3dbd063b453aa.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f87550>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_bdde321407e0617465e2c6087965eacb.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7dd50>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_cd985b5d25380159976394204fa1b305.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_543be940df4e436172bbd44aab30d92f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_b7294291312f8d62d3ad3e03be36e261.jpg not downloaded yet
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_71a4e8deb758824f01b6e1ffffff73d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_49a45cc323599702cdab39e7c4d57877.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_c2361c0a3ee23bb66d0465b177a215d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_3d56b19de76bf27f562659898102f243.jpg not downloaded yet
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73b10>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_543be940df4e436172bbd44aab30d92f.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb1550>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_71a4e8deb758824f01b6e1ffffff73d8.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c22f90>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_49a45cc323599702cdab39e7c4d57877.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3209af50>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_c2361c0a3ee23bb66d0465b177a215d1.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52
2026-04-27 07:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52, skipping ID generation
2026-04-27 07:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with scrape type 1
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 sending to next pipeline
2026-04-27 07:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52, identifier: JM47084
2026-04-27 07:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with identifier: JM47084
2026-04-27 07:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with identifier: JM47084
2026-04-27 07:56:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7fdbb2-835c-50e8-a5b1-34a444ee9e52 with identifier: JM47084 to the API
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_c2361c0a3ee23bb66d0465b177a215d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'city': 'Hamburg',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:30:34Z',
 'fuel_type': 'petrol',
 'id': '9e7fdbb2-835c-50e8-a5b1-34a444ee9e52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.5544,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM47084',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'location_confidence': 'geocoded',
 'longitude': 9.9946,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 77388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_33fa8a7e4023a37f24ddcf296ce3c886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_f83352a5df484ab7d717c71eec93b8c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_ccffebe9c08489d7de4a20bbef36119d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_c2361c0a3ee23bb66d0465b177a215d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9e7fdbb2-835c-50e8-a5b1-34a444ee9e52/9e7fdbb2-835c-50e8-a5b1-34a444ee9e52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3a07777e1a9003e38886b0884d72/pa/JM47084_1828c5bc29baded318e3dbd063b453aa.jpg',
             'Width': 800}],
 'postal_code': '20038',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Hamburg',
 'region_code': 'DE-HH',
 'registration_date': '2009-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-04-27 07:56:27 [auto1.de] INFO: Saving data for JM47084: {'created_time': 1777276587.085097, 'last_price_update_time': 1777276587.085106, 'has_photos': True, 'auction_closing_time': 1777390234.0}
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_f66c58b2366ee14cf65f19d6cf3b35c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_2e78c0e71b5b601e750a5a27b5e90645.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG81101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK55062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS17247> (referer: https://www.auto1.com/v1/car-details-view/HS17247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX14210> (referer: https://www.auto1.com/v1/car-details-view/EX14210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA23243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY61240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK45490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE49682> (referer: https://www.auto1.com/v1/car-details-view/TE49682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_3d56b19de76bf27f562659898102f243.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_ca74cd84fd135b13e702a71b1b91f4a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_b7294291312f8d62d3ad3e03be36e261.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165e50>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_f66c58b2366ee14cf65f19d6cf3b35c6.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4f90>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_2e78c0e71b5b601e750a5a27b5e90645.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_6d93b1b9b6210137a3953269426323a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_c9d305b8c902a72cb499eeadbda6b24e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ece344a0dddbac28e61bdea7bf006d29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ede697a3974e353db943454367c4384b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_cc636daf1b0e778f86e8b220c71a6199.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56bcf403-f8a6-5740-8fb7-92806684335b with identifier: HS17247
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bcf403-f8a6-5740-8fb7-92806684335b with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_6043f47ff7965db0d45de232c32db164.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267161b4-3db5-5e00-a938-639dd7f3bc4b with identifier: EX14210
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267161b4-3db5-5e00-a938-639dd7f3bc4b with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_1ebc97b65ecc4ccaf32563ad02690b4a.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827be606-ebb4-5a38-97d0-1742fa95d493 with identifier: TE49682
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827be606-ebb4-5a38-97d0-1742fa95d493 with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_858422d39197fda029fa48d2f671f196.jpg not downloaded yet
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30164950>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_3d56b19de76bf27f562659898102f243.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd3990>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_ca74cd84fd135b13e702a71b1b91f4a1.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6af50>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_b7294291312f8d62d3ad3e03be36e261.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_11745046b43344f30e9a2496386f36ad.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_e10c2e00c3452d4082277fa973e344ce.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68ae2fa83af75f2859ca0eecea8eb107.jpg not downloaded yet
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_8b5b4a2f816e94b365756292538d6324.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4dd10>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_6d93b1b9b6210137a3953269426323a1.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01d50>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_c9d305b8c902a72cb499eeadbda6b24e.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad, skipping ID generation
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad sending to next pipeline
2026-04-27 07:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad, identifier: CN60683
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eab2210>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ece344a0dddbac28e61bdea7bf006d29.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d69190>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ede697a3974e353db943454367c4384b.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebf290ab-e4dc-5140-8f2e-91204bf66d82
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebf290ab-e4dc-5140-8f2e-91204bf66d82, skipping ID generation
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf290ab-e4dc-5140-8f2e-91204bf66d82 with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebf290ab-e4dc-5140-8f2e-91204bf66d82 sending to next pipeline
2026-04-27 07:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebf290ab-e4dc-5140-8f2e-91204bf66d82, identifier: WD67147
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b522d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_cc636daf1b0e778f86e8b220c71a6199.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_2d1ec966f9c6a9de9063fa9f1862919f.jpg not downloaded yet
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3216e27a6b5788320fbf0dda86c32b30.jpg not downloaded yet
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1daf20e691f378276dcae2f9b6446185.jpg not downloaded yet
2026-04-27 07:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-04-27 07:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-04-27 07:56:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683 to the API
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_c9d305b8c902a72cb499eeadbda6b24e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'city': 'Ellerau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 201,
 'expiration_date': '2026-04-28T15:26:13Z',
 'fuel_type': 'diesel',
 'id': '660254aa-bb61-5b8b-a43c-c189b9f7f4ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN60683',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'KGM',
 'model': 'Musso Grand',
 'odometer': 22740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_cd985b5d25380159976394204fa1b305.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_bdde321407e0617465e2c6087965eacb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_543be940df4e436172bbd44aab30d92f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_71a4e8deb758824f01b6e1ffffff73d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_c9d305b8c902a72cb499eeadbda6b24e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_ca74cd84fd135b13e702a71b1b91f4a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_2e78c0e71b5b601e750a5a27b5e90645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_f66c58b2366ee14cf65f19d6cf3b35c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_b7294291312f8d62d3ad3e03be36e261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_660254aa-bb61-5b8b-a43c-c189b9f7f4ad/660254aa-bb61-5b8b-a43c-c189b9f7f4ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/85/c085110425dddb4f4a3f02532e59ea1f/pa/CN60683_3d56b19de76bf27f562659898102f243.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2025-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KGM Musso Grand 2.2 e-Xdi Style AWD',
 'transmission': 'automatic',
 'trim': 'Style AWD',
 'year': 2025}
2026-04-27 07:56:28 [auto1.de] INFO: Saving data for CN60683: {'created_time': 1777276588.861528, 'last_price_update_time': 1777276588.86154, 'has_photos': True, 'auction_closing_time': 1777389973.0}
2026-04-27 07:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebf290ab-e4dc-5140-8f2e-91204bf66d82 with identifier: WD67147
2026-04-27 07:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebf290ab-e4dc-5140-8f2e-91204bf66d82 with identifier: WD67147
2026-04-27 07:56:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebf290ab-e4dc-5140-8f2e-91204bf66d82 with identifier: WD67147 to the API
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ede697a3974e353db943454367c4384b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-04-28T15:40:53Z',
 'fuel_type': 'petrol',
 'id': 'ebf290ab-e4dc-5140-8f2e-91204bf66d82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD67147',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 300508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_661c9ccca33a59240116faa4c90896f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ede697a3974e353db943454367c4384b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_ece344a0dddbac28e61bdea7bf006d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_cc4fafb67dd8ff6b6608ff992d0d3cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_9b408de4b423d27c2c920e3edf366e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ebf290ab-e4dc-5140-8f2e-91204bf66d82/ebf290ab-e4dc-5140-8f2e-91204bf66d82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/95/36954d1f99250c6f4178ef310627508f/pa/WD67147_a479825d1970ef1b1573bee79de1a246.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2009-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-04-27 07:56:29 [auto1.de] INFO: Saving data for WD67147: {'created_time': 1777276589.228024, 'last_price_update_time': 1777276589.228035, 'has_photos': True, 'auction_closing_time': 1777390853.0}
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_845f1b15456a6cda7112b991d22d3d4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_d23a4ba6ac541fc556143ae6baff268e.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_8a6675f23e42470c11a759b048d0a5f7.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5372cdf448e650a7dddff9eaadbb6e6d.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP15031> (referer: https://www.auto1.com/v1/car-details-view/BP15031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN42898> (referer: https://www.auto1.com/v1/car-details-view/GN42898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV45704> (referer: https://www.auto1.com/v1/car-details-view/UV45704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB76592> (referer: https://www.auto1.com/v1/car-details-view/FB76592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY44353> (referer: https://www.auto1.com/v1/car-details-view/WY44353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA32853> (referer: https://www.auto1.com/v1/car-details-view/DA32853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ44904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX61933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e699d0>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_8b5b4a2f816e94b365756292538d6324.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bdca542-996e-58b3-bffc-bdcdb88c92be
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bdca542-996e-58b3-bffc-bdcdb88c92be, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdca542-996e-58b3-bffc-bdcdb88c92be with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bdca542-996e-58b3-bffc-bdcdb88c92be sending to next pipeline
2026-04-27 07:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bdca542-996e-58b3-bffc-bdcdb88c92be, identifier: EA73737
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bdca542-996e-58b3-bffc-bdcdb88c92be with identifier: EA73737
2026-04-27 07:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bdca542-996e-58b3-bffc-bdcdb88c92be with identifier: EA73737
2026-04-27 07:56:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bdca542-996e-58b3-bffc-bdcdb88c92be with identifier: EA73737 to the API
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_8b5b4a2f816e94b365756292538d6324.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Saarlouis',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:50:34Z',
 'fuel_type': 'petrol',
 'id': '7bdca542-996e-58b3-bffc-bdcdb88c92be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.3137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA73737',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'location_confidence': 'geocoded',
 'longitude': 6.7515,
 'make': 'Audi',
 'model': 'A3',
 'odometer': 151711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_6d93b1b9b6210137a3953269426323a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_8b5b4a2f816e94b365756292538d6324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_cc636daf1b0e778f86e8b220c71a6199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_49a45cc323599702cdab39e7c4d57877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_9cd193a2b888772441bae156275b9835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_aee087496443adb864d8f9c831d5139c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_878ea48a3fd96d1fb9582c82afaa6e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_1af0c2947154ff9afa03eb45a5ab52d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_0444cb6b2b2c3ced32470aa21005a925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7bdca542-996e-58b3-bffc-bdcdb88c92be/7bdca542-996e-58b3-bffc-bdcdb88c92be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/13/7f13abfd97ce5cde5bbb2ff016fb81e6/pa/EA73737_c597f8e6b129779b6bbdb68760bb01f3.jpg',
             'Width': 800}],
 'postal_code': '66740',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2012-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-04-27 07:56:29 [auto1.de] INFO: Saving data for EA73737: {'created_time': 1777276589.846992, 'last_price_update_time': 1777276589.847004, 'has_photos': True, 'auction_closing_time': 1777391434.0}
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_5aaa8af727c7b727a5b04b98ba5e72e2.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_d2bbb00e6b87fc5a832f93d7a1945f90.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5bb3eca6fe7439cb838ea5b256b6db62.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_858422d39197fda029fa48d2f671f196.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_334b8c70d7a757a1b2b5ce0d12e5b04e.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_6fb04c8034c4122bc6c51c2af559a5c9.jpg not downloaded yet
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7aec2c317a9d6a1d52b3ab2efea8ad93.jpg not downloaded yet
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cada10>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_845f1b15456a6cda7112b991d22d3d4d.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0131271b-e41e-5b4d-92e0-fffa714f31c7 with identifier: BP15031
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0131271b-e41e-5b4d-92e0-fffa714f31c7 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_19aef9150e6a2e9865ac5e22bafd635f.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with identifier: GN42898
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_1930f4b4e0b59b25889a25b355433e42.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb48c73-6521-5a5b-8e6b-5930d77badec with identifier: UV45704
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb48c73-6521-5a5b-8e6b-5930d77badec with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_a3cb44a784292692a503cf2ded96b233.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa9226a6-12b9-50c1-81eb-3f025e357e81 with identifier: FB76592
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa9226a6-12b9-50c1-81eb-3f025e357e81 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3ab857f6986a6433dc348b0b13d01525.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add75127-5296-568d-85f4-7e2fa8c068ea with identifier: WY44353
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add75127-5296-568d-85f4-7e2fa8c068ea with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_80a0ce7e48b9f2d3844c403cd907bb10.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210b041c-3660-5805-858d-b6f7f9b448e7 with identifier: DA32853
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210b041c-3660-5805-858d-b6f7f9b448e7 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_dc2417d7181e6eb3b08c50d2e94dd96e.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_11745046b43344f30e9a2496386f36ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68ae2fa83af75f2859ca0eecea8eb107.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_2d1ec966f9c6a9de9063fa9f1862919f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_c7254610eede0d32d1b3cef12b0911b2.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3568ce4ca6a114e6a9697d89b375431e.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_d7bacb9392393dce6c437fd8566db567.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_c748d379dfe5eba2ba75f78fa05ff79c.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_6de3ca1788235ff6b6d85df89064cd8e.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_0a9f6cf52bb553311e81d25169c2d9ba.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_2f1d929b6acb990638b65c147d58d36d.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_282b11959e9cbc32669199d01ab95ce5.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_1e57eea00163a55e7356a7ae7679f7b9.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1daf20e691f378276dcae2f9b6446185.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_e10c2e00c3452d4082277fa973e344ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3216e27a6b5788320fbf0dda86c32b30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ead59d0>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_858422d39197fda029fa48d2f671f196.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_72cc0bee4c130f8d74e8fa13adb35495.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_c51c686d427f38ffc22b242bbc766a1d.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7d291c324b966551adf0713055f1ddf3.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_508cd2ee806b3861d9e00791a909a336.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_673c546fb7736e68737d7121da4cb56d.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_18005b4f21b9cca81f04dcf6878291ba.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_8052968584b51877468f85de67e9d4bd.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_53a2e4987e5a9385658cb5aedde5d077.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_80ab6030447f56ccebdc1b2c25a27f34.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5bb3eca6fe7439cb838ea5b256b6db62.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f40c90>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_11745046b43344f30e9a2496386f36ad.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f10d0>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68ae2fa83af75f2859ca0eecea8eb107.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a55190>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_2d1ec966f9c6a9de9063fa9f1862919f.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_b47c8769960334569047f28b9372210c.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_94c445924845744b481bb215020c683c.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68751b066114b266fc10178df808e485.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_32c6193402086c0ee595ec33a8ba7a2e.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_fd443f398e863def22664bd4f3d7f846.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_586f2592dbbecc12397f963b7b98d654.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ee4b318e3c9574ec55e2138f92d06a17.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_6cf76d2c98a5341a39c0896401f81986.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_a90bc8530e1d0ff40637a2b9c05e6c3a.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_dc2417d7181e6eb3b08c50d2e94dd96e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3ab857f6986a6433dc348b0b13d01525.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_a3cb44a784292692a503cf2ded96b233.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_f47e3c6dc37338c867ee2703ca7f82a1.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_fb29c754c935cc758137f17c8eba6abf.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1e65019390ac0ab367249f2eae557d51.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_e921dc6f652490ea5c9894b790e7da8c.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_4f16e5b4e6123313a94866e6198d8b4a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_dfcaf11bf9e7e220a53655a898c58693.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_692cb8a65b086e9a87223bdc23c9eb7a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0a6ca30011ec9121d296fb8e6d743726.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_4602f7394e32deb5546ad327677f4abc.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003cb10>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1daf20e691f378276dcae2f9b6446185.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e409d0>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_e10c2e00c3452d4082277fa973e344ce.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22be9990>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3216e27a6b5788320fbf0dda86c32b30.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ed90>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5bb3eca6fe7439cb838ea5b256b6db62.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_abea22dcf6ad75e9a4ca64088ea65cc1.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_14eaa902af77e892d7e899e607abde7e.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_722d80093d8e6202823833900fee31dc.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_1bb2e680406e61fa00650ee6b0680e37.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_62f5f885df9c62c05eaf53ed42245c54.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_1e57eea00163a55e7356a7ae7679f7b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY47782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU32806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV82025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV10859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f36cd0>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_dc2417d7181e6eb3b08c50d2e94dd96e.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3ebd0>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3ab857f6986a6433dc348b0b13d01525.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c1ac10>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_a3cb44a784292692a503cf2ded96b233.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_d1d89a5c7ad806bab96471e03825aee0.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_c4ef78879ffdfb0b1a01c8e8659b4d28.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3f3d50dbc33b6fe41c56d83a45f77321.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_fd8ba83b3b423b3e8d4076818c1f6393.jpg not downloaded yet
2026-04-27 07:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ee4b318e3c9574ec55e2138f92d06a17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_a90bc8530e1d0ff40637a2b9c05e6c3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0efa11ef75b6b0393c4c7daad004a401.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed97bc7dc0e2197f0d989032afec5de1.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ed9429a348b0efe726799f238de0ae14.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_26e918a2ae5791e6db2636b4cd7ab711.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d4dd0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_1e57eea00163a55e7356a7ae7679f7b9.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0938ea17e63e8626758d473982879ff3.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed4db71af23f8b4e3820f84ed9d2b0b0.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ff3def2a2dbd764201509e60ce9caadb.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_5b095b13246817135557f61151b0979b.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA23243> (referer: https://www.auto1.com/v1/car-details-view/PA23243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eae890>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ee4b318e3c9574ec55e2138f92d06a17.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eac790>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_a90bc8530e1d0ff40637a2b9c05e6c3a.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_62f5f885df9c62c05eaf53ed42245c54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_9ebb4bf4a8420f46543cf3f541507983.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_553e052f6e6950f30bf02caac99aa5c4.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_07632490d93d4a9444f632bc18b54d17.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0f20eb4eed16765e162ecdf8f3c16d9d.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_1bb2e680406e61fa00650ee6b0680e37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_4602f7394e32deb5546ad327677f4abc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY61240> (referer: https://www.auto1.com/v1/car-details-view/YY61240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_14eaa902af77e892d7e899e607abde7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_722d80093d8e6202823833900fee31dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with identifier: PA23243
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_5ce8494d9d6d7fa214ebd17f4108136c.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_6a8ebe3b10294ea65a280d19dbb71756.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe96d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_62f5f885df9c62c05eaf53ed42245c54.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_476e5ee200aec4e8748f0782d465bfb4.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed4db71af23f8b4e3820f84ed9d2b0b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_fd8ba83b3b423b3e8d4076818c1f6393.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_bd91a9ccd36814bf2692b6671b328bd2.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_4574ed202c71a1f5794eef773be5310d.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30050710>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_1bb2e680406e61fa00650ee6b0680e37.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d909d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_4602f7394e32deb5546ad327677f4abc.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with identifier: YY61240
2026-04-27 07:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with scrape type 1
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_7d711c5dbdb4d8284dd585a2cd658677.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca34d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_14eaa902af77e892d7e899e607abde7e.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5890>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_722d80093d8e6202823833900fee31dc.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_043ba55842e372e04579e6933b75ff18.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_d62c0559e197c10fe18e70f248367637.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0938ea17e63e8626758d473982879ff3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ff3def2a2dbd764201509e60ce9caadb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3f3d50dbc33b6fe41c56d83a45f77321.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_5b095b13246817135557f61151b0979b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0f20eb4eed16765e162ecdf8f3c16d9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_240d9b4ded43922ee22e91cafa0d7c41.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_38b11a45ba4f6a482c192f78c54e2c5c.jpg not downloaded yet
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f59190>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed4db71af23f8b4e3820f84ed9d2b0b0.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a805d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_fd8ba83b3b423b3e8d4076818c1f6393.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_822762849bf84856f421a1c0bf8f63a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_2d8a46bfa74e807f074ac556581e139c.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_1fa8192966c14ffbf500d3807cdf677f.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_6a8ebe3b10294ea65a280d19dbb71756.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_476e5ee200aec4e8748f0782d465bfb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_553e052f6e6950f30bf02caac99aa5c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_00e9f5b218da6c2d8a141c78b0c2a9b3.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_633b7714f8aa6db1221e7b6407e72189.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_6cf76d2c98a5341a39c0896401f81986.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_7d711c5dbdb4d8284dd585a2cd658677.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3290>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0938ea17e63e8626758d473982879ff3.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc2a10>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ff3def2a2dbd764201509e60ce9caadb.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c26290>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3f3d50dbc33b6fe41c56d83a45f77321.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077f50>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_5b095b13246817135557f61151b0979b.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c258d0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0f20eb4eed16765e162ecdf8f3c16d9d.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_07632490d93d4a9444f632bc18b54d17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_bd91a9ccd36814bf2692b6671b328bd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_e115c083437d384b2ca662f22acb6948.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_3040b03d129fac32dffc4c39199a47c0.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_80a0ce7e48b9f2d3844c403cd907bb10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_5ce8494d9d6d7fa214ebd17f4108136c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_4574ed202c71a1f5794eef773be5310d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_9ebb4bf4a8420f46543cf3f541507983.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ44904> (referer: https://www.auto1.com/v1/car-details-view/KJ44904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8e010>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_822762849bf84856f421a1c0bf8f63a5.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f646d0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_6a8ebe3b10294ea65a280d19dbb71756.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e90cd0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_476e5ee200aec4e8748f0782d465bfb4.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65ad0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_553e052f6e6950f30bf02caac99aa5c4.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c30e19561ce73f8c18d30a60c5007513.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX61933> (referer: https://www.auto1.com/v1/car-details-view/MX61933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_240d9b4ded43922ee22e91cafa0d7c41.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_38b11a45ba4f6a482c192f78c54e2c5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_49cd67eb5f9d7e861ff000fb421ad116.jpg not downloaded yet
2026-04-27 07:56:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dca750>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_6cf76d2c98a5341a39c0896401f81986.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd4cd0>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_7d711c5dbdb4d8284dd585a2cd658677.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b99290>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_07632490d93d4a9444f632bc18b54d17.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35910>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_bd91a9ccd36814bf2692b6671b328bd2.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4ca10>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_80a0ce7e48b9f2d3844c403cd907bb10.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30280450>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_5ce8494d9d6d7fa214ebd17f4108136c.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b98590>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_4574ed202c71a1f5794eef773be5310d.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5ad10>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_9ebb4bf4a8420f46543cf3f541507983.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with identifier: KJ44904
2026-04-27 07:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with scrape type 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_b22d1b546fbc0515c680c4ba8ebf2972.jpg not downloaded yet
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_d62c0559e197c10fe18e70f248367637.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_043ba55842e372e04579e6933b75ff18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_86ac330fd82bfcece67ebf3ea24313a5.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_24e07a739e700e02c8a84a3c7d2c1403.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91b4f09-ef7f-5a9e-8b77-79d956a40431 with identifier: MX61933
2026-04-27 07:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91b4f09-ef7f-5a9e-8b77-79d956a40431 with scrape type 1
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_fdaac559d0f9c5488adc3e9b1fb39e09.jpg not downloaded yet
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301e9c10>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_240d9b4ded43922ee22e91cafa0d7c41.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a0d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_38b11a45ba4f6a482c192f78c54e2c5c.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c5d9eb7b2fa395899a31dc475374ed33.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_a87e819434d286f2b1f03e08c355436b.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_633b7714f8aa6db1221e7b6407e72189.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c30e19561ce73f8c18d30a60c5007513.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_1fa8192966c14ffbf500d3807cdf677f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_35f70e0c66252dad43f91152b359971f.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_00e9f5b218da6c2d8a141c78b0c2a9b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_e115c083437d384b2ca662f22acb6948.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_3040b03d129fac32dffc4c39199a47c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_26e918a2ae5791e6db2636b4cd7ab711.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_815090e5f736a4cb5142f6738f524710.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK60822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK45490> (referer: https://www.auto1.com/v1/car-details-view/HK45490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_75848e058a1ca055ba27d5d6f9272526.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15dd0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_d62c0559e197c10fe18e70f248367637.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b78b10>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_043ba55842e372e04579e6933b75ff18.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_cda1eb9ad6587384ac3fe10c0fa727c6.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_8a0ba0e18eafc685ad00db7f90a9f2a4.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_b22d1b546fbc0515c680c4ba8ebf2972.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_fdaac559d0f9c5488adc3e9b1fb39e09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d37df5e0e2ef171c19221c8379ee25e8.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_49cd67eb5f9d7e861ff000fb421ad116.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_b408ddbcb4163a377c21764ed764b32c.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_86ac330fd82bfcece67ebf3ea24313a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4179719f7246684b3bb697e411e18cb4.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30164410>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_633b7714f8aa6db1221e7b6407e72189.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a23f50>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c30e19561ce73f8c18d30a60c5007513.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd55d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_1fa8192966c14ffbf500d3807cdf677f.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30052190>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_00e9f5b218da6c2d8a141c78b0c2a9b3.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c1a790>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_e115c083437d384b2ca662f22acb6948.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbdf10>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_3040b03d129fac32dffc4c39199a47c0.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cef810>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_26e918a2ae5791e6db2636b4cd7ab711.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640e50ff-353e-5927-a996-23b6deabf80f with identifier: HK45490
2026-04-27 07:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640e50ff-353e-5927-a996-23b6deabf80f with scrape type 1
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ff4f8e1f034ca78739182d6e0c8f4732.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_171576c1d1851a081baea719cbe9ccde.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c5d9eb7b2fa395899a31dc475374ed33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_24e07a739e700e02c8a84a3c7d2c1403.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed97bc7dc0e2197f0d989032afec5de1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_36dd631642ae24b07eb638ec74fb5809.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_80376ddbb4da661eb3dbd2c00b47245b.jpg not downloaded yet
2026-04-27 07:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_a87e819434d286f2b1f03e08c355436b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ed9429a348b0efe726799f238de0ae14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a61a3fa958b4a8ccbdd57cc0f59901d3.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d75e0dd589d7ab97fd0371a29f31f36d.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_d78bf17072a13833a7dbe905d47e3737.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0efa11ef75b6b0393c4c7daad004a401.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_86fed14761ced6ea4905f3020a738067.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceded0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_b22d1b546fbc0515c680c4ba8ebf2972.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbf310>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_fdaac559d0f9c5488adc3e9b1fb39e09.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302904d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_49cd67eb5f9d7e861ff000fb421ad116.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f28c50>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_86ac330fd82bfcece67ebf3ea24313a5.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4ddd836dfc99193f643c765ea9d6eb6d.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_8564d6b82576fc5e188133131a877c2c.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_cda1eb9ad6587384ac3fe10c0fa727c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ff4f8e1f034ca78739182d6e0c8f4732.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a7c59f4b620d32878f9c8bd66e3538c0.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_35f70e0c66252dad43f91152b359971f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_8a0ba0e18eafc685ad00db7f90a9f2a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_75848e058a1ca055ba27d5d6f9272526.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ae7574ff7fd47272dcacbcc762370ba3.jpg not downloaded yet
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3cd50>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c5d9eb7b2fa395899a31dc475374ed33.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9
2026-04-27 07:56:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9, skipping ID generation
2026-04-27 07:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with scrape type 1
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 sending to next pipeline
2026-04-27 07:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9, identifier: YY61240
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30079910>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_24e07a739e700e02c8a84a3c7d2c1403.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07b90>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed97bc7dc0e2197f0d989032afec5de1.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b52110>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_a87e819434d286f2b1f03e08c355436b.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a54fd0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ed9429a348b0efe726799f238de0ae14.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4bb65510>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0efa11ef75b6b0393c4c7daad004a401.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_692a786f525be0568085d27ef8c101a2.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with identifier: YY61240
2026-04-27 07:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with identifier: YY61240
2026-04-27 07:56:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9 with identifier: YY61240 to the API
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c5d9eb7b2fa395899a31dc475374ed33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'city': 'Ketzin',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:00:07Z',
 'fuel_type': 'petrol',
 'id': 'ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY61240',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 35334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_7d711c5dbdb4d8284dd585a2cd658677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_d62c0559e197c10fe18e70f248367637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_38b11a45ba4f6a482c192f78c54e2c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_1fa8192966c14ffbf500d3807cdf677f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_633b7714f8aa6db1221e7b6407e72189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_3040b03d129fac32dffc4c39199a47c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c30e19561ce73f8c18d30a60c5007513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_49cd67eb5f9d7e861ff000fb421ad116.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_86ac330fd82bfcece67ebf3ea24313a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9/ac49f997-cf5a-5ba7-998a-9d7b7a3a7bc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/11/2e11d3ab6d379e70b55a335a675c9756/pa/YY61240_c5d9eb7b2fa395899a31dc475374ed33.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-04-27 07:56:37 [auto1.de] INFO: Saving data for YY61240: {'created_time': 1777276597.103277, 'last_price_update_time': 1777276597.103288, 'has_photos': True, 'auction_closing_time': 1777388407.0}
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4179719f7246684b3bb697e411e18cb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_5ae24b0e83a440b64c295be26df44577.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV10859> (referer: https://www.auto1.com/v1/car-details-view/RV10859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU32806> (referer: https://www.auto1.com/v1/car-details-view/HU32806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY47782> (referer: https://www.auto1.com/v1/car-details-view/CY47782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV82025> (referer: https://www.auto1.com/v1/car-details-view/DV82025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8cf90>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_cda1eb9ad6587384ac3fe10c0fa727c6.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3dd0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ff4f8e1f034ca78739182d6e0c8f4732.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebebbd0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_35f70e0c66252dad43f91152b359971f.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6da50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_8a0ba0e18eafc685ad00db7f90a9f2a4.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0ac50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_75848e058a1ca055ba27d5d6f9272526.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a61a3fa958b4a8ccbdd57cc0f59901d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_171576c1d1851a081baea719cbe9ccde.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_b408ddbcb4163a377c21764ed764b32c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_30955a6b0a6e74e746eb3426bfe18bdf.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4ddd836dfc99193f643c765ea9d6eb6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_8564d6b82576fc5e188133131a877c2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_89d7526a3bce679cdfe29e4709be3f2c.jpg not downloaded yet
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6e390>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4179719f7246684b3bb697e411e18cb4.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bd2b11b-657d-515b-88e0-34161afd829f with identifier: RV10859
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd2b11b-657d-515b-88e0-34161afd829f with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_22cbe2178418722391a97ffc109181fd.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b692a94-7a19-5aaf-9b03-21bf3503e224 with identifier: HU32806
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b692a94-7a19-5aaf-9b03-21bf3503e224 with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7ed25beaf4afc281e6c8e2df2e38942c.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c72db6e-6142-5dfa-b45a-431925689d75 with identifier: CY47782
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c72db6e-6142-5dfa-b45a-431925689d75 with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6f376f86479a29fccf6e168270ed3417.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with identifier: DV82025
2026-04-27 07:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with scrape type 1
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1c184709fb9efaa9534be41d1ae6fee9.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_c8a2a8ede2c39dc99a57913c039cf0f3.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_49aeb7d0417a4397fc1f16631cb19185.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_12b68bbd7d3a062cb403198cba2306be.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6c8d2c2885bea90ecc31d4b915d03423.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_5ab76ee0a4f40094e19f8600a91a595c.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_692a786f525be0568085d27ef8c101a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ae7574ff7fd47272dcacbcc762370ba3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_5ae24b0e83a440b64c295be26df44577.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_fd67202507cc4c87be07113497442f90.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_86014c287ad84fa1932f5b81d9fda582.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_26edb07eff23b105c4c44ac247e6b98f.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_347bbe1b55fa9712e347dd10ca6c66bc.jpg not downloaded yet
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_aee2c41677f3aefd96cb0a1866649622.jpg not downloaded yet
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_86fed14761ced6ea4905f3020a738067.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d75e0dd589d7ab97fd0371a29f31f36d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cec510>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a61a3fa958b4a8ccbdd57cc0f59901d3.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f61b410>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_171576c1d1851a081baea719cbe9ccde.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebaad0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_b408ddbcb4163a377c21764ed764b32c.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30302b10>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4ddd836dfc99193f643c765ea9d6eb6d.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb91d0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_8564d6b82576fc5e188133131a877c2c.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_2dfbec6341dce8b22152dce68d709ba1.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d6e5c9d64a19e7c905dab2a2e59557e2.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_9dbc18fc7441b926cea3a322f62355e9.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_f2b85bc6d7f9538cce6b49cccc31d8a3.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_80376ddbb4da661eb3dbd2c00b47245b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a7c59f4b620d32878f9c8bd66e3538c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_6e3e491ab539cc84e9cde70eb5cb109c.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7632a7b21ffcb67dc4c0678a1a21d9b5.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_77f77db8e6f1806f0b2fcf8592313ec2.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_3f0daf1fee514839644f24c9d8713d98.jpg not downloaded yet
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4d390>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_692a786f525be0568085d27ef8c101a2.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b29ad0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ae7574ff7fd47272dcacbcc762370ba3.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9ea50>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_5ae24b0e83a440b64c295be26df44577.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b783d0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_86fed14761ced6ea4905f3020a738067.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9ecd0>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d75e0dd589d7ab97fd0371a29f31f36d.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_c4ef78879ffdfb0b1a01c8e8659b4d28.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_c8eecd6a84251d5c3e44101b4ba1340e.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_ccc47edafb8879f379315bc660b860b6.jpg not downloaded yet
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1f06f88e996a17d5152f2ff221b047bf.jpg not downloaded yet
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_36dd631642ae24b07eb638ec74fb5809.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcd010>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_80376ddbb4da661eb3dbd2c00b47245b.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042210>
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a7c59f4b620d32878f9c8bd66e3538c0.jpg saved to cache
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c91b4f09-ef7f-5a9e-8b77-79d956a40431
2026-04-27 07:56:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c91b4f09-ef7f-5a9e-8b77-79d956a40431, skipping ID generation
2026-04-27 07:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91b4f09-ef7f-5a9e-8b77-79d956a40431 with scrape type 1
2026-04-27 07:56:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c91b4f09-ef7f-5a9e-8b77-79d956a40431 sending to next pipeline
2026-04-27 07:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c91b4f09-ef7f-5a9e-8b77-79d956a40431, identifier: MX61933
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_8e993edcf4fe2143662d3fa5de04d2ce.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_a20e4a70e99a430cb6e1912eaecfcd50.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_31e0ac4134362765a7853fa4614599f3.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c91b4f09-ef7f-5a9e-8b77-79d956a40431 with identifier: MX61933
2026-04-27 07:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c91b4f09-ef7f-5a9e-8b77-79d956a40431 with identifier: MX61933
2026-04-27 07:56:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c91b4f09-ef7f-5a9e-8b77-79d956a40431 with identifier: MX61933 to the API
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a7c59f4b620d32878f9c8bd66e3538c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:01:48Z',
 'fuel_type': 'petrol',
 'id': 'c91b4f09-ef7f-5a9e-8b77-79d956a40431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX61933',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 36133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_fdaac559d0f9c5488adc3e9b1fb39e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_35f70e0c66252dad43f91152b359971f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_75848e058a1ca055ba27d5d6f9272526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_8a0ba0e18eafc685ad00db7f90a9f2a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_b408ddbcb4163a377c21764ed764b32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_171576c1d1851a081baea719cbe9ccde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a61a3fa958b4a8ccbdd57cc0f59901d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_86fed14761ced6ea4905f3020a738067.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_a7c59f4b620d32878f9c8bd66e3538c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c91b4f09-ef7f-5a9e-8b77-79d956a40431/c91b4f09-ef7f-5a9e-8b77-79d956a40431_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b8/e8b822f5c175588a752d5cc174093a14/pa/MX61933_692a786f525be0568085d27ef8c101a2.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2025-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2025}
2026-04-27 07:56:39 [auto1.de] INFO: Saving data for MX61933: {'created_time': 1777276599.550113, 'last_price_update_time': 1777276599.550124, 'has_photos': True, 'auction_closing_time': 1777388508.0}
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_d1d89a5c7ad806bab96471e03825aee0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_abea22dcf6ad75e9a4ca64088ea65cc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_a94518e3272b6ded04324a41e6b9b8be.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_fa602dc33a9677e448bc49f15e693a81.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_bdd7e60fbbe791db598639cc81b7655d.jpg not downloaded yet
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a72050>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_c4ef78879ffdfb0b1a01c8e8659b4d28.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c25390>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_36dd631642ae24b07eb638ec74fb5809.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6f376f86479a29fccf6e168270ed3417.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1c184709fb9efaa9534be41d1ae6fee9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_899479b2e58bfd5dee3b9af72a6ac848.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_9bf12b1391e1c34bfc20797ed3df408a.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_7312ebf1b13fbf5afd2c09f3a02a81a0.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_926624e4602faf99f720bfaa29c0d517.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d7b6922f8f4175c81fa7ed9020378141.jpg not downloaded yet
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_cf2fa1986ed027a184be3c9930b5a58c.jpg not downloaded yet
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003aa10>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_d1d89a5c7ad806bab96471e03825aee0.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301974d0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_abea22dcf6ad75e9a4ca64088ea65cc1.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_f2b85bc6d7f9538cce6b49cccc31d8a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_5ab76ee0a4f40094e19f8600a91a595c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028c510>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6f376f86479a29fccf6e168270ed3417.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcd410>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1c184709fb9efaa9534be41d1ae6fee9.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_12b68bbd7d3a062cb403198cba2306be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6c8d2c2885bea90ecc31d4b915d03423.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bf8d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_f2b85bc6d7f9538cce6b49cccc31d8a3.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a71450>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_5ab76ee0a4f40094e19f8600a91a595c.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_2d8a46bfa74e807f074ac556581e139c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b7aed0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_12b68bbd7d3a062cb403198cba2306be.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d37df5e0e2ef171c19221c8379ee25e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b7a210>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6c8d2c2885bea90ecc31d4b915d03423.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_9dbc18fc7441b926cea3a322f62355e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_3f0daf1fee514839644f24c9d8713d98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_77f77db8e6f1806f0b2fcf8592313ec2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_31e0ac4134362765a7853fa4614599f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f4590>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_2d8a46bfa74e807f074ac556581e139c.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33
2026-04-27 07:56:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3209998-ed4c-5533-be6f-5b4d5c9c6d33, skipping ID generation
2026-04-27 07:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with scrape type 1
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3209998-ed4c-5533-be6f-5b4d5c9c6d33 sending to next pipeline
2026-04-27 07:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3209998-ed4c-5533-be6f-5b4d5c9c6d33, identifier: PA23243
2026-04-27 07:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with identifier: PA23243
2026-04-27 07:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with identifier: PA23243
2026-04-27 07:56:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3209998-ed4c-5533-be6f-5b4d5c9c6d33 with identifier: PA23243 to the API
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_2d8a46bfa74e807f074ac556581e139c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'city': 'Lörrach',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-04-28T15:24:36Z',
 'fuel_type': 'petrol',
 'id': 'c3209998-ed4c-5533-be6f-5b4d5c9c6d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.6181,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA23243',
 'listing': 'auction',
 'location': 'DE, Lörrach',
 'location_confidence': 'geocoded',
 'longitude': 7.6589,
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 215515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_5ce8494d9d6d7fa214ebd17f4108136c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_6a8ebe3b10294ea65a280d19dbb71756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_476e5ee200aec4e8748f0782d465bfb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_bd91a9ccd36814bf2692b6671b328bd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_4574ed202c71a1f5794eef773be5310d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_043ba55842e372e04579e6933b75ff18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_240d9b4ded43922ee22e91cafa0d7c41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3216399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_2d8a46bfa74e807f074ac556581e139c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_00e9f5b218da6c2d8a141c78b0c2a9b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3209998-ed4c-5533-be6f-5b4d5c9c6d33/c3209998-ed4c-5533-be6f-5b4d5c9c6d33_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ee/14ee24259990f4047597c6b7d1e6133c/pa/PA23243_e115c083437d384b2ca662f22acb6948.jpg',
             'Width': 800}],
 'postal_code': '79539',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2012-06-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 sDrive 35is',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-04-27 07:56:40 [auto1.de] INFO: Saving data for PA23243: {'created_time': 1777276600.878554, 'last_price_update_time': 1777276600.878565, 'has_photos': True, 'auction_closing_time': 1777389876.0}
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_bdd7e60fbbe791db598639cc81b7655d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_926624e4602faf99f720bfaa29c0d517.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1f06f88e996a17d5152f2ff221b047bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_fa602dc33a9677e448bc49f15e693a81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d7b6922f8f4175c81fa7ed9020378141.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_cf2fa1986ed027a184be3c9930b5a58c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8cf50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d37df5e0e2ef171c19221c8379ee25e8.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016cf90>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_9dbc18fc7441b926cea3a322f62355e9.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceb010>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_3f0daf1fee514839644f24c9d8713d98.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300420d0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_77f77db8e6f1806f0b2fcf8592313ec2.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016eb90>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_31e0ac4134362765a7853fa4614599f3.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_d78bf17072a13833a7dbe905d47e3737.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301df590>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_bdd7e60fbbe791db598639cc81b7655d.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179e10>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_926624e4602faf99f720bfaa29c0d517.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d390>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1f06f88e996a17d5152f2ff221b047bf.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc0fd0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_fa602dc33a9677e448bc49f15e693a81.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b61b50>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d7b6922f8f4175c81fa7ed9020378141.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30093810>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_cf2fa1986ed027a184be3c9930b5a58c.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_815090e5f736a4cb5142f6738f524710.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_9bf12b1391e1c34bfc20797ed3df408a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_7312ebf1b13fbf5afd2c09f3a02a81a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1d50>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_d78bf17072a13833a7dbe905d47e3737.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2ed10>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_815090e5f736a4cb5142f6738f524710.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1634a7b4-cf5c-538f-8e3d-e86008c7e22f sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f, identifier: KJ44904
2026-04-27 07:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with identifier: KJ44904
2026-04-27 07:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with identifier: KJ44904
2026-04-27 07:56:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1634a7b4-cf5c-538f-8e3d-e86008c7e22f with identifier: KJ44904 to the API
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_815090e5f736a4cb5142f6738f524710.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Gelsenkirchen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:39:49Z',
 'fuel_type': 'petrol',
 'id': '1634a7b4-cf5c-538f-8e3d-e86008c7e22f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5087,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ44904',
 'listing': 'auction',
 'location': 'Gelsenkirchen',
 'location_confidence': 'geocoded',
 'longitude': 7.0968,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 58142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_b22d1b546fbc0515c680c4ba8ebf2972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_24e07a739e700e02c8a84a3c7d2c1403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_a87e819434d286f2b1f03e08c355436b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_815090e5f736a4cb5142f6738f524710.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_cda1eb9ad6587384ac3fe10c0fa727c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d37df5e0e2ef171c19221c8379ee25e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4179719f7246684b3bb697e411e18cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_36dd631642ae24b07eb638ec74fb5809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_d75e0dd589d7ab97fd0371a29f31f36d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1634a7b4-cf5c-538f-8e3d-e86008c7e22f/1634a7b4-cf5c-538f-8e3d-e86008c7e22f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d2/3bd2b290c2a17e67062dbd617e2f65f8/pa/KJ44904_4ddd836dfc99193f643c765ea9d6eb6d.jpg',
             'Width': 800}],
 'postal_code': '45879',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Münster',
 'province_code': 'DE-055',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 2016}
2026-04-27 07:56:42 [auto1.de] INFO: Saving data for KJ44904: {'created_time': 1777276602.216268, 'last_price_update_time': 1777276602.216277, 'has_photos': True, 'auction_closing_time': 1777390789.0}
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_ccc47edafb8879f379315bc660b860b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_c8eecd6a84251d5c3e44101b4ba1340e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_8e993edcf4fe2143662d3fa5de04d2ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7632a7b21ffcb67dc4c0678a1a21d9b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_a94518e3272b6ded04324a41e6b9b8be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_899479b2e58bfd5dee3b9af72a6ac848.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_a20e4a70e99a430cb6e1912eaecfcd50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_6e3e491ab539cc84e9cde70eb5cb109c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2e310>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_9bf12b1391e1c34bfc20797ed3df408a.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff3a90>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_7312ebf1b13fbf5afd2c09f3a02a81a0.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_347bbe1b55fa9712e347dd10ca6c66bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fbcdd0>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_ccc47edafb8879f379315bc660b860b6.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d85a10>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_c8eecd6a84251d5c3e44101b4ba1340e.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f1150>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_8e993edcf4fe2143662d3fa5de04d2ce.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042cd0>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7632a7b21ffcb67dc4c0678a1a21d9b5.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d6e5c9d64a19e7c905dab2a2e59557e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_2dfbec6341dce8b22152dce68d709ba1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_aee2c41677f3aefd96cb0a1866649622.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_86014c287ad84fa1932f5b81d9fda582.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_49aeb7d0417a4397fc1f16631cb19185.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016fcd0>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_a94518e3272b6ded04324a41e6b9b8be.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05e50>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_899479b2e58bfd5dee3b9af72a6ac848.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1550>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_a20e4a70e99a430cb6e1912eaecfcd50.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a574d0>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_6e3e491ab539cc84e9cde70eb5cb109c.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2b010>
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_347bbe1b55fa9712e347dd10ca6c66bc.jpg saved to cache
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c72db6e-6142-5dfa-b45a-431925689d75
2026-04-27 07:56:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c72db6e-6142-5dfa-b45a-431925689d75, skipping ID generation
2026-04-27 07:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c72db6e-6142-5dfa-b45a-431925689d75 with scrape type 1
2026-04-27 07:56:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c72db6e-6142-5dfa-b45a-431925689d75 sending to next pipeline
2026-04-27 07:56:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c72db6e-6142-5dfa-b45a-431925689d75, identifier: CY47782
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_fd67202507cc4c87be07113497442f90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_26edb07eff23b105c4c44ac247e6b98f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c72db6e-6142-5dfa-b45a-431925689d75 with identifier: CY47782
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c72db6e-6142-5dfa-b45a-431925689d75 with identifier: CY47782
2026-04-27 07:56:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c72db6e-6142-5dfa-b45a-431925689d75 with identifier: CY47782 to the API
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_347bbe1b55fa9712e347dd10ca6c66bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Saarbrücken',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:11:06Z',
 'fuel_type': 'petrol',
 'id': '9c72db6e-6142-5dfa-b45a-431925689d75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2461,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY47782',
 'listing': 'auction',
 'location': 'DE, Saarbrücken',
 'location_confidence': 'geocoded',
 'longitude': 7.0022,
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 103499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6f376f86479a29fccf6e168270ed3417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_6c8d2c2885bea90ecc31d4b915d03423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_347bbe1b55fa9712e347dd10ca6c66bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_9dbc18fc7441b926cea3a322f62355e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c72db6e-6142-5dfa-b45a-431925689d75/9c72db6e-6142-5dfa-b45a-431925689d75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/bf/8dbf11331374ca62a7c3dd8d585718b6/pa/CY47782_77f77db8e6f1806f0b2fcf8592313ec2.jpg',
             'Width': 800}],
 'postal_code': '66111',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2003-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 FSI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2003}
2026-04-27 07:56:43 [auto1.de] INFO: Saving data for CY47782: {'created_time': 1777276603.375387, 'last_price_update_time': 1777276603.375396, 'has_photos': True, 'auction_closing_time': 1777389066.0}
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7ed25beaf4afc281e6c8e2df2e38942c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_22cbe2178418722391a97ffc109181fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_89d7526a3bce679cdfe29e4709be3f2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_30955a6b0a6e74e746eb3426bfe18bdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4024a790>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d6e5c9d64a19e7c905dab2a2e59557e2.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1ad0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_2dfbec6341dce8b22152dce68d709ba1.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1ad0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_aee2c41677f3aefd96cb0a1866649622.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9
2026-04-27 07:56:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 318686ad-7dd7-528c-bf52-a5d8bd567ff9, skipping ID generation
2026-04-27 07:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with scrape type 1
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 318686ad-7dd7-528c-bf52-a5d8bd567ff9 sending to next pipeline
2026-04-27 07:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 318686ad-7dd7-528c-bf52-a5d8bd567ff9, identifier: DV82025
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30054b50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_86014c287ad84fa1932f5b81d9fda582.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3bd0>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_49aeb7d0417a4397fc1f16631cb19185.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91b50>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_fd67202507cc4c87be07113497442f90.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2a590>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_26edb07eff23b105c4c44ac247e6b98f.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with identifier: DV82025
2026-04-27 07:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with identifier: DV82025
2026-04-27 07:56:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 318686ad-7dd7-528c-bf52-a5d8bd567ff9 with identifier: DV82025 to the API
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_aee2c41677f3aefd96cb0a1866649622.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'city': 'Fockbek',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:08:34Z',
 'fuel_type': 'diesel',
 'id': '318686ad-7dd7-528c-bf52-a5d8bd567ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV82025',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 230718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1c184709fb9efaa9534be41d1ae6fee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_5ab76ee0a4f40094e19f8600a91a595c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_aee2c41677f3aefd96cb0a1866649622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_f2b85bc6d7f9538cce6b49cccc31d8a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_3f0daf1fee514839644f24c9d8713d98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_1f06f88e996a17d5152f2ff221b047bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_31e0ac4134362765a7853fa4614599f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_bdd7e60fbbe791db598639cc81b7655d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_7312ebf1b13fbf5afd2c09f3a02a81a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_318686ad-7dd7-528c-bf52-a5d8bd567ff9/318686ad-7dd7-528c-bf52-a5d8bd567ff9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971fe295a677660958b04116f38c5540/pa/DV82025_cf2fa1986ed027a184be3c9930b5a58c.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2021-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D4 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-04-27 07:56:44 [auto1.de] INFO: Saving data for DV82025: {'created_time': 1777276604.236575, 'last_price_update_time': 1777276604.236589, 'has_photos': True, 'auction_closing_time': 1777388914.0}
2026-04-27 07:56:44 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 77 pages/min), scraped 103 items (at 44 items/min)
2026-04-27 07:56:44 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_692cb8a65b086e9a87223bdc23c9eb7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_dfcaf11bf9e7e220a53655a898c58693.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_e921dc6f652490ea5c9894b790e7da8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_4f16e5b4e6123313a94866e6198d8b4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1e65019390ac0ab367249f2eae557d51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_fb29c754c935cc758137f17c8eba6abf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceb3d0>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7ed25beaf4afc281e6c8e2df2e38942c.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b692a94-7a19-5aaf-9b03-21bf3503e224
2026-04-27 07:56:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b692a94-7a19-5aaf-9b03-21bf3503e224, skipping ID generation
2026-04-27 07:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b692a94-7a19-5aaf-9b03-21bf3503e224 with scrape type 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b692a94-7a19-5aaf-9b03-21bf3503e224 sending to next pipeline
2026-04-27 07:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b692a94-7a19-5aaf-9b03-21bf3503e224, identifier: HU32806
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30056f50>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_22cbe2178418722391a97ffc109181fd.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bd2b11b-657d-515b-88e0-34161afd829f
2026-04-27 07:56:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bd2b11b-657d-515b-88e0-34161afd829f, skipping ID generation
2026-04-27 07:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd2b11b-657d-515b-88e0-34161afd829f with scrape type 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bd2b11b-657d-515b-88e0-34161afd829f sending to next pipeline
2026-04-27 07:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bd2b11b-657d-515b-88e0-34161afd829f, identifier: RV10859
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc950>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_89d7526a3bce679cdfe29e4709be3f2c.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9da50>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_30955a6b0a6e74e746eb3426bfe18bdf.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b692a94-7a19-5aaf-9b03-21bf3503e224 with identifier: HU32806
2026-04-27 07:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b692a94-7a19-5aaf-9b03-21bf3503e224 with identifier: HU32806
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b692a94-7a19-5aaf-9b03-21bf3503e224 with identifier: HU32806 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7ed25beaf4afc281e6c8e2df2e38942c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Buch',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:03:58Z',
 'fuel_type': 'diesel',
 'id': '6b692a94-7a19-5aaf-9b03-21bf3503e224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU32806',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'BMW',
 'model': '3er',
 'odometer': 258558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7ed25beaf4afc281e6c8e2df2e38942c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_12b68bbd7d3a062cb403198cba2306be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_26edb07eff23b105c4c44ac247e6b98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d6e5c9d64a19e7c905dab2a2e59557e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_7632a7b21ffcb67dc4c0678a1a21d9b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_ccc47edafb8879f379315bc660b860b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_a20e4a70e99a430cb6e1912eaecfcd50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_fa602dc33a9677e448bc49f15e693a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_9bf12b1391e1c34bfc20797ed3df408a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b692a94-7a19-5aaf-9b03-21bf3503e224/6b692a94-7a19-5aaf-9b03-21bf3503e224_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/8d/d48da279e70fee8966374b14b2898364/pa/HU32806_d7b6922f8f4175c81fa7ed9020378141.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2013-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-04-27 07:56:45 [auto1.de] INFO: Saving data for HU32806: {'created_time': 1777276605.281155, 'last_price_update_time': 1777276605.281165, 'has_photos': True, 'auction_closing_time': 1777388638.0}
2026-04-27 07:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bd2b11b-657d-515b-88e0-34161afd829f with identifier: RV10859
2026-04-27 07:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bd2b11b-657d-515b-88e0-34161afd829f with identifier: RV10859
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bd2b11b-657d-515b-88e0-34161afd829f with identifier: RV10859 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_22cbe2178418722391a97ffc109181fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 264,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.7L',
 'engine_horse_power': 455,
 'expiration_date': '2026-04-28T15:13:05Z',
 'fuel_type': 'petrol',
 'id': '8bd2b11b-657d-515b-88e0-34161afd829f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV10859',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 136719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_22cbe2178418722391a97ffc109181fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_49aeb7d0417a4397fc1f16631cb19185.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_86014c287ad84fa1932f5b81d9fda582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_2dfbec6341dce8b22152dce68d709ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_6e3e491ab539cc84e9cde70eb5cb109c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_c8eecd6a84251d5c3e44101b4ba1340e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_8e993edcf4fe2143662d3fa5de04d2ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_a94518e3272b6ded04324a41e6b9b8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_899479b2e58bfd5dee3b9af72a6ac848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bd2b11b-657d-515b-88e0-34161afd829f/8bd2b11b-657d-515b-88e0-34161afd829f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/c1/25c12074b12c028339dc003b3cd095ed/pa/RV10859_926624e4602faf99f720bfaa29c0d517.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-11-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 500 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-04-27 07:56:45 [auto1.de] INFO: Saving data for RV10859: {'created_time': 1777276605.642814, 'last_price_update_time': 1777276605.642826, 'has_photos': True, 'auction_closing_time': 1777389185.0}
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_f47e3c6dc37338c867ee2703ca7f82a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_32c6193402086c0ee595ec33a8ba7a2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_fd443f398e863def22664bd4f3d7f846.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_94c445924845744b481bb215020c683c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_586f2592dbbecc12397f963b7b98d654.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68751b066114b266fc10178df808e485.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3029a6d0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_692cb8a65b086e9a87223bdc23c9eb7a.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8e850>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_dfcaf11bf9e7e220a53655a898c58693.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ac950>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_e921dc6f652490ea5c9894b790e7da8c.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d7110>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_4f16e5b4e6123313a94866e6198d8b4a.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ac6d0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1e65019390ac0ab367249f2eae557d51.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce9b90>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_fb29c754c935cc758137f17c8eba6abf.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_b47c8769960334569047f28b9372210c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300aea50>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_f47e3c6dc37338c867ee2703ca7f82a1.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f04750>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_32c6193402086c0ee595ec33a8ba7a2e.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b62c90>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_fd443f398e863def22664bd4f3d7f846.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a60910>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_94c445924845744b481bb215020c683c.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30278810>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_586f2592dbbecc12397f963b7b98d654.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebb2190>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68751b066114b266fc10178df808e485.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_80ab6030447f56ccebdc1b2c25a27f34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_673c546fb7736e68737d7121da4cb56d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_8052968584b51877468f85de67e9d4bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_18005b4f21b9cca81f04dcf6878291ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b99f90>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_b47c8769960334569047f28b9372210c.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0a6ca30011ec9121d296fb8e6d743726.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_c8a2a8ede2c39dc99a57913c039cf0f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_53a2e4987e5a9385658cb5aedde5d077.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_6de3ca1788235ff6b6d85df89064cd8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b99250>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_80ab6030447f56ccebdc1b2c25a27f34.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 210b041c-3660-5805-858d-b6f7f9b448e7
2026-04-27 07:56:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 210b041c-3660-5805-858d-b6f7f9b448e7, skipping ID generation
2026-04-27 07:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210b041c-3660-5805-858d-b6f7f9b448e7 with scrape type 1
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 210b041c-3660-5805-858d-b6f7f9b448e7 sending to next pipeline
2026-04-27 07:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 210b041c-3660-5805-858d-b6f7f9b448e7, identifier: DA32853
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 210b041c-3660-5805-858d-b6f7f9b448e7 with identifier: DA32853
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 210b041c-3660-5805-858d-b6f7f9b448e7 with identifier: DA32853
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 210b041c-3660-5805-858d-b6f7f9b448e7 with identifier: DA32853 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_80ab6030447f56ccebdc1b2c25a27f34.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Mainz-Kastel',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:32:32Z',
 'fuel_type': 'petrol',
 'id': '210b041c-3660-5805-858d-b6f7f9b448e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.0102,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA32853',
 'listing': 'auction',
 'location': 'DE, Mainz-Kastel (Wiesbaden)',
 'location_confidence': 'geocoded',
 'longitude': 8.2844,
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 93694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_dc2417d7181e6eb3b08c50d2e94dd96e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_1e57eea00163a55e7356a7ae7679f7b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_80ab6030447f56ccebdc1b2c25a27f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_a90bc8530e1d0ff40637a2b9c05e6c3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_210b041c-3660-5805-858d-b6f7f9b448e7/210b041c-3660-5805-858d-b6f7f9b448e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/fc/59fc9809ea1920cfc15b1fa91abdf2e0/pa/DA32853_4602f7394e32deb5546ad327677f4abc.jpg',
             'Width': 800}],
 'postal_code': '55252',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2009-05-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-04-27 07:56:46 [auto1.de] INFO: Saving data for DA32853: {'created_time': 1777276606.970953, 'last_price_update_time': 1777276606.970965, 'has_photos': True, 'auction_closing_time': 1777390352.0}
2026-04-27 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_72cc0bee4c130f8d74e8fa13adb35495.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebbc10>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_673c546fb7736e68737d7121da4cb56d.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_508cd2ee806b3861d9e00791a909a336.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_c51c686d427f38ffc22b242bbc766a1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_c748d379dfe5eba2ba75f78fa05ff79c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7d291c324b966551adf0713055f1ddf3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_282b11959e9cbc32669199d01ab95ce5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_0a9f6cf52bb553311e81d25169c2d9ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_2f1d929b6acb990638b65c147d58d36d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2bad0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_8052968584b51877468f85de67e9d4bd.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ced390>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_18005b4f21b9cca81f04dcf6878291ba.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a20750>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0a6ca30011ec9121d296fb8e6d743726.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb4910>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_c8a2a8ede2c39dc99a57913c039cf0f3.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 640e50ff-353e-5927-a996-23b6deabf80f
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 640e50ff-353e-5927-a996-23b6deabf80f, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640e50ff-353e-5927-a996-23b6deabf80f with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 640e50ff-353e-5927-a996-23b6deabf80f sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 640e50ff-353e-5927-a996-23b6deabf80f, identifier: HK45490
2026-04-27 07:56:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d517d0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_53a2e4987e5a9385658cb5aedde5d077.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2a790>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_6de3ca1788235ff6b6d85df89064cd8e.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 640e50ff-353e-5927-a996-23b6deabf80f with identifier: HK45490
2026-04-27 07:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 640e50ff-353e-5927-a996-23b6deabf80f with identifier: HK45490
2026-04-27 07:56:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 640e50ff-353e-5927-a996-23b6deabf80f with identifier: HK45490 to the API
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_c8a2a8ede2c39dc99a57913c039cf0f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'city': 'Dessau-Roßlau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2026-04-28T15:37:54Z',
 'fuel_type': 'petrol',
 'id': '640e50ff-353e-5927-a996-23b6deabf80f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.8333,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK45490',
 'listing': 'auction',
 'location': 'DE, Dessau-Roßlau',
 'location_confidence': 'geocoded',
 'longitude': 12.25,
 'make': 'Hyundai',
 'model': 'i30 Fastback',
 'odometer': 49522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ff4f8e1f034ca78739182d6e0c8f4732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_80376ddbb4da661eb3dbd2c00b47245b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_d78bf17072a13833a7dbe905d47e3737.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_8564d6b82576fc5e188133131a877c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_ae7574ff7fd47272dcacbcc762370ba3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_5ae24b0e83a440b64c295be26df44577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_30955a6b0a6e74e746eb3426bfe18bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_89d7526a3bce679cdfe29e4709be3f2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_c8a2a8ede2c39dc99a57913c039cf0f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_640e50ff-353e-5927-a996-23b6deabf80f/640e50ff-353e-5927-a996-23b6deabf80f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/6d/2a6d49fb244cf33b6804180afe59361f/pa/HK45490_fd67202507cc4c87be07113497442f90.jpg',
             'Width': 800}],
 'postal_code': '06861',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 Fastback 2.0 T-GDI N Performance',
 'transmission': 'automatic',
 'trim': 'N Performance',
 'year': 2021}
2026-04-27 07:56:47 [auto1.de] INFO: Saving data for HK45490: {'created_time': 1777276607.852981, 'last_price_update_time': 1777276607.852991, 'has_photos': True, 'auction_closing_time': 1777390674.0}
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_d7bacb9392393dce6c437fd8566db567.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_c7254610eede0d32d1b3cef12b0911b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fbcd0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_72cc0bee4c130f8d74e8fa13adb35495.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cf290>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_508cd2ee806b3861d9e00791a909a336.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3e2d0>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_c51c686d427f38ffc22b242bbc766a1d.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29f50>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_c748d379dfe5eba2ba75f78fa05ff79c.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3df50>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7d291c324b966551adf0713055f1ddf3.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30281590>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_282b11959e9cbc32669199d01ab95ce5.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item add75127-5296-568d-85f4-7e2fa8c068ea
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: add75127-5296-568d-85f4-7e2fa8c068ea, skipping ID generation
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add75127-5296-568d-85f4-7e2fa8c068ea with scrape type 1
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item add75127-5296-568d-85f4-7e2fa8c068ea sending to next pipeline
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: add75127-5296-568d-85f4-7e2fa8c068ea, identifier: WY44353
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028c350>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_0a9f6cf52bb553311e81d25169c2d9ba.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efb48c73-6521-5a5b-8e6b-5930d77badec
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb48c73-6521-5a5b-8e6b-5930d77badec, skipping ID generation
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb48c73-6521-5a5b-8e6b-5930d77badec with scrape type 1
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb48c73-6521-5a5b-8e6b-5930d77badec sending to next pipeline
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb48c73-6521-5a5b-8e6b-5930d77badec, identifier: UV45704
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003bd90>
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_2f1d929b6acb990638b65c147d58d36d.jpg saved to cache
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa9226a6-12b9-50c1-81eb-3f025e357e81
2026-04-27 07:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa9226a6-12b9-50c1-81eb-3f025e357e81, skipping ID generation
2026-04-27 07:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa9226a6-12b9-50c1-81eb-3f025e357e81 with scrape type 1
2026-04-27 07:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa9226a6-12b9-50c1-81eb-3f025e357e81 sending to next pipeline
2026-04-27 07:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa9226a6-12b9-50c1-81eb-3f025e357e81, identifier: FB76592
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_19aef9150e6a2e9865ac5e22bafd635f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_1930f4b4e0b59b25889a25b355433e42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3568ce4ca6a114e6a9697d89b375431e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: add75127-5296-568d-85f4-7e2fa8c068ea with identifier: WY44353
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: add75127-5296-568d-85f4-7e2fa8c068ea with identifier: WY44353
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: add75127-5296-568d-85f4-7e2fa8c068ea with identifier: WY44353 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_282b11959e9cbc32669199d01ab95ce5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Ibbenbüren',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:58:21Z',
 'fuel_type': 'petrol',
 'id': 'add75127-5296-568d-85f4-7e2fa8c068ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2601,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY44353',
 'listing': 'auction',
 'location': 'DE, Ibbenbüren',
 'location_confidence': 'geocoded',
 'longitude': 7.7135,
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 77718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2271593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_80a0ce7e48b9f2d3844c403cd907bb10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_282b11959e9cbc32669199d01ab95ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1887043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_53a2e4987e5a9385658cb5aedde5d077.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1780343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_6cf76d2c98a5341a39c0896401f81986.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2076150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0a6ca30011ec9121d296fb8e6d743726.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_62f5f885df9c62c05eaf53ed42245c54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_fd8ba83b3b423b3e8d4076818c1f6393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_26e918a2ae5791e6db2636b4cd7ab711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_5b095b13246817135557f61151b0979b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_add75127-5296-568d-85f4-7e2fa8c068ea/add75127-5296-568d-85f4-7e2fa8c068ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/94/e894a1d716eee34fbe33bed7b48a67b7/pa/WY44353_0f20eb4eed16765e162ecdf8f3c16d9d.jpg',
             'Width': 800}],
 'postal_code': '49477',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Münster',
 'province_code': 'DE-055',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-12-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2016}
2026-04-27 07:56:49 [auto1.de] INFO: Saving data for WY44353: {'created_time': 1777276609.041236, 'last_price_update_time': 1777276609.04125, 'has_photos': True, 'auction_closing_time': 1777391901.0}
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb48c73-6521-5a5b-8e6b-5930d77badec with identifier: UV45704
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb48c73-6521-5a5b-8e6b-5930d77badec with identifier: UV45704
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb48c73-6521-5a5b-8e6b-5930d77badec with identifier: UV45704 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_0a9f6cf52bb553311e81d25169c2d9ba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Atting',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:48:22Z',
 'fuel_type': 'diesel',
 'id': 'efb48c73-6521-5a5b-8e6b-5930d77badec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV45704',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 413008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_a3cb44a784292692a503cf2ded96b233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_0a9f6cf52bb553311e81d25169c2d9ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_18005b4f21b9cca81f04dcf6878291ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_586f2592dbbecc12397f963b7b98d654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_dfcaf11bf9e7e220a53655a898c58693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb48c73-6521-5a5b-8e6b-5930d77badec/efb48c73-6521-5a5b-8e6b-5930d77badec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0c/370c3589129d026d1503f7c83919ca1e/pa/UV45704_722d80093d8e6202823833900fee31dc.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2012-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2012}
2026-04-27 07:56:49 [auto1.de] INFO: Saving data for UV45704: {'created_time': 1777276609.548682, 'last_price_update_time': 1777276609.548693, 'has_photos': True, 'auction_closing_time': 1777391302.0}
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa9226a6-12b9-50c1-81eb-3f025e357e81 with identifier: FB76592
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa9226a6-12b9-50c1-81eb-3f025e357e81 with identifier: FB76592
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa9226a6-12b9-50c1-81eb-3f025e357e81 with identifier: FB76592 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_2f1d929b6acb990638b65c147d58d36d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': 'Rental',
 'city': 'Dortmund',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:03:51Z',
 'fuel_type': 'petrol',
 'id': 'aa9226a6-12b9-50c1-81eb-3f025e357e81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB76592',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Fiat',
 'model': '500C',
 'odometer': 53656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3ab857f6986a6433dc348b0b13d01525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_2f1d929b6acb990638b65c147d58d36d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_8052968584b51877468f85de67e9d4bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ee4b318e3c9574ec55e2138f92d06a17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_692cb8a65b086e9a87223bdc23c9eb7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_1bb2e680406e61fa00650ee6b0680e37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_3f3d50dbc33b6fe41c56d83a45f77321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ed9429a348b0efe726799f238de0ae14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_ff3def2a2dbd764201509e60ce9caadb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa9226a6-12b9-50c1-81eb-3f025e357e81/aa9226a6-12b9-50c1-81eb-3f025e357e81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/86/e2864ab73c7a5d8b6276b6db930b693b/pa/FB76592_07632490d93d4a9444f632bc18b54d17.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-04-27 07:56:50 [auto1.de] INFO: Saving data for FB76592: {'created_time': 1777276610.161276, 'last_price_update_time': 1777276610.161288, 'has_photos': True, 'auction_closing_time': 1777388631.0}
2026-04-27 07:56:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cc650>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_d7bacb9392393dce6c437fd8566db567.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05090>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_c7254610eede0d32d1b3cef12b0911b2.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_334b8c70d7a757a1b2b5ce0d12e5b04e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5372cdf448e650a7dddff9eaadbb6e6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b789d0>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_19aef9150e6a2e9865ac5e22bafd635f.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0131271b-e41e-5b4d-92e0-fffa714f31c7
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0131271b-e41e-5b4d-92e0-fffa714f31c7, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0131271b-e41e-5b4d-92e0-fffa714f31c7 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0131271b-e41e-5b4d-92e0-fffa714f31c7 sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0131271b-e41e-5b4d-92e0-fffa714f31c7, identifier: BP15031
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d190>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_1930f4b4e0b59b25889a25b355433e42.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: def5d7be-0fba-585f-a8bd-6f42c2a2cb03, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item def5d7be-0fba-585f-a8bd-6f42c2a2cb03 sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: def5d7be-0fba-585f-a8bd-6f42c2a2cb03, identifier: GN42898
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8d610>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3568ce4ca6a114e6a9697d89b375431e.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_d23a4ba6ac541fc556143ae6baff268e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0131271b-e41e-5b4d-92e0-fffa714f31c7 with identifier: BP15031
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0131271b-e41e-5b4d-92e0-fffa714f31c7 with identifier: BP15031
2026-04-27 07:56:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0131271b-e41e-5b4d-92e0-fffa714f31c7 with identifier: BP15031 to the API
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_19aef9150e6a2e9865ac5e22bafd635f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'category': None,
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 320,
 'expiration_date': '2026-04-28T15:28:14Z',
 'fuel_type': 'hybrid',
 'id': '0131271b-e41e-5b4d-92e0-fffa714f31c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP15031',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 120019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_19aef9150e6a2e9865ac5e22bafd635f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_c748d379dfe5eba2ba75f78fa05ff79c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_508cd2ee806b3861d9e00791a909a336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_32c6193402086c0ee595ec33a8ba7a2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_e921dc6f652490ea5c9894b790e7da8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_abea22dcf6ad75e9a4ca64088ea65cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_d1d89a5c7ad806bab96471e03825aee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0efa11ef75b6b0393c4c7daad004a401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_0938ea17e63e8626758d473982879ff3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0131271b-e41e-5b4d-92e0-fffa714f31c7/0131271b-e41e-5b4d-92e0-fffa714f31c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/f5/e5f582b2042f755fea44b0ed93742fd8/pa/BP15031_9ebb4bf4a8420f46543cf3f541507983.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 de 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-04-27 07:56:50 [auto1.de] INFO: Saving data for BP15031: {'created_time': 1777276610.978208, 'last_price_update_time': 1777276610.978217, 'has_photos': True, 'auction_closing_time': 1777390094.0}
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with identifier: GN42898
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with identifier: GN42898
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: def5d7be-0fba-585f-a8bd-6f42c2a2cb03 with identifier: GN42898 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_1930f4b4e0b59b25889a25b355433e42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 417,
 'expiration_date': '2026-04-28T15:56:21Z',
 'fuel_type': 'petrol',
 'id': 'def5d7be-0fba-585f-a8bd-6f42c2a2cb03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN42898',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Cadillac',
 'model': 'CT6',
 'odometer': 115792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_1930f4b4e0b59b25889a25b355433e42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_6de3ca1788235ff6b6d85df89064cd8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_673c546fb7736e68737d7121da4cb56d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_fd443f398e863def22664bd4f3d7f846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_4f16e5b4e6123313a94866e6198d8b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_14eaa902af77e892d7e899e607abde7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_c4ef78879ffdfb0b1a01c8e8659b4d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed97bc7dc0e2197f0d989032afec5de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_ed4db71af23f8b4e3820f84ed9d2b0b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_def5d7be-0fba-585f-a8bd-6f42c2a2cb03/def5d7be-0fba-585f-a8bd-6f42c2a2cb03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/87/9a870c207c56151fd95047e975c12960/pa/GN42898_553e052f6e6950f30bf02caac99aa5c4.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2017-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cadillac CT6 3.0 V6 Platinum AWD',
 'transmission': 'automatic',
 'trim': 'Platinum AWD',
 'year': 2017}
2026-04-27 07:56:51 [auto1.de] INFO: Saving data for GN42898: {'created_time': 1777276611.53803, 'last_price_update_time': 1777276611.538041, 'has_photos': True, 'auction_closing_time': 1777391781.0}
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_5aaa8af727c7b727a5b04b98ba5e72e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_8a6675f23e42470c11a759b048d0a5f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7aec2c317a9d6a1d52b3ab2efea8ad93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_d2bbb00e6b87fc5a832f93d7a1945f90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c12d10>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_334b8c70d7a757a1b2b5ce0d12e5b04e.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3c90>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5372cdf448e650a7dddff9eaadbb6e6d.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_6043f47ff7965db0d45de232c32db164.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b83410>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_d23a4ba6ac541fc556143ae6baff268e.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30058390>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_5aaa8af727c7b727a5b04b98ba5e72e2.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9b290>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_8a6675f23e42470c11a759b048d0a5f7.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b32550>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7aec2c317a9d6a1d52b3ab2efea8ad93.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 827be606-ebb4-5a38-97d0-1742fa95d493
2026-04-27 07:56:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 827be606-ebb4-5a38-97d0-1742fa95d493, skipping ID generation
2026-04-27 07:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827be606-ebb4-5a38-97d0-1742fa95d493 with scrape type 1
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 827be606-ebb4-5a38-97d0-1742fa95d493 sending to next pipeline
2026-04-27 07:56:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827be606-ebb4-5a38-97d0-1742fa95d493, identifier: TE49682
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ad0d0>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_d2bbb00e6b87fc5a832f93d7a1945f90.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827be606-ebb4-5a38-97d0-1742fa95d493 with identifier: TE49682
2026-04-27 07:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827be606-ebb4-5a38-97d0-1742fa95d493 with identifier: TE49682
2026-04-27 07:56:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827be606-ebb4-5a38-97d0-1742fa95d493 with identifier: TE49682 to the API
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7aec2c317a9d6a1d52b3ab2efea8ad93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:44:24Z',
 'fuel_type': 'petrol',
 'id': '827be606-ebb4-5a38-97d0-1742fa95d493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE49682',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 109764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_858422d39197fda029fa48d2f671f196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68ae2fa83af75f2859ca0eecea8eb107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1daf20e691f378276dcae2f9b6446185.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5372cdf448e650a7dddff9eaadbb6e6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_5bb3eca6fe7439cb838ea5b256b6db62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7aec2c317a9d6a1d52b3ab2efea8ad93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_d7bacb9392393dce6c437fd8566db567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_7d291c324b966551adf0713055f1ddf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_68751b066114b266fc10178df808e485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_827be606-ebb4-5a38-97d0-1742fa95d493/827be606-ebb4-5a38-97d0-1742fa95d493_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/e2/12e2ac54b3cccf8424256c936c3cb742/pa/TE49682_1e65019390ac0ab367249f2eae557d51.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2015-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2015}
2026-04-27 07:56:52 [auto1.de] INFO: Saving data for TE49682: {'created_time': 1777276612.512759, 'last_price_update_time': 1777276612.512772, 'has_photos': True, 'auction_closing_time': 1777391064.0}
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_999d1c3901b561d4e9899e363c26dbca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a24d0936e3c50665f856155e8e75e04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_2c4750d1005a8091ed8f748182f938f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_b3c4453d28fd159bd28b6647c89e7d28.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_3eab97c4b659de058285abd99f1d10dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK55062> (referer: https://www.auto1.com/v1/car-details-view/YK55062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB89914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4c48aad0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_6043f47ff7965db0d45de232c32db164.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56bcf403-f8a6-5740-8fb7-92806684335b
2026-04-27 07:56:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56bcf403-f8a6-5740-8fb7-92806684335b, skipping ID generation
2026-04-27 07:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bcf403-f8a6-5740-8fb7-92806684335b with scrape type 1
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56bcf403-f8a6-5740-8fb7-92806684335b sending to next pipeline
2026-04-27 07:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56bcf403-f8a6-5740-8fb7-92806684335b, identifier: HS17247
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56bcf403-f8a6-5740-8fb7-92806684335b with identifier: HS17247
2026-04-27 07:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56bcf403-f8a6-5740-8fb7-92806684335b with identifier: HS17247
2026-04-27 07:56:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56bcf403-f8a6-5740-8fb7-92806684335b with identifier: HS17247 to the API
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_6043f47ff7965db0d45de232c32db164.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-04-28T15:46:33Z',
 'fuel_type': 'petrol',
 'id': '56bcf403-f8a6-5740-8fb7-92806684335b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS17247',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 13596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_6043f47ff7965db0d45de232c32db164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_11745046b43344f30e9a2496386f36ad.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_2d1ec966f9c6a9de9063fa9f1862919f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_d23a4ba6ac541fc556143ae6baff268e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_5aaa8af727c7b727a5b04b98ba5e72e2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_334b8c70d7a757a1b2b5ce0d12e5b04e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_c7254610eede0d32d1b3cef12b0911b2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_72cc0bee4c130f8d74e8fa13adb35495.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_b47c8769960334569047f28b9372210c.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56bcf403-f8a6-5740-8fb7-92806684335b/56bcf403-f8a6-5740-8fb7-92806684335b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/81609ce6094d74667670a8c81e2fea4b/pa/HS17247_f47e3c6dc37338c867ee2703ca7f82a1.jpg',
             'Width': 450}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2023-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-04-27 07:56:53 [auto1.de] INFO: Saving data for HS17247: {'created_time': 1777276613.06254, 'last_price_update_time': 1777276613.062551, 'has_photos': True, 'auction_closing_time': 1777391193.0}
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_0c17d02b1992b9e3815a19e2a74829d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_79edbdc9d47a88f8f332cdc04a2fe0e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a92d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_999d1c3901b561d4e9899e363c26dbca.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d5d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a24d0936e3c50665f856155e8e75e04.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75590>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_2c4750d1005a8091ed8f748182f938f3.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b337d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_b3c4453d28fd159bd28b6647c89e7d28.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f06910>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_3eab97c4b659de058285abd99f1d10dc.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7e8e71-38ce-5d61-8446-2fa27a3a864e with identifier: YK55062
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_1fc1a759c5b6d17d2c58cb6199092018.jpg not downloaded yet
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_ec30d8eecca5789f74f4263fbc41b921.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD36657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG81101> (referer: https://www.auto1.com/v1/car-details-view/DG81101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR46282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_4e4a2ae590e421961f12cc987fba03d7.jpg not downloaded yet
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_30c0f2b211173ff32c6becfa420a14e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK60822> (referer: https://www.auto1.com/v1/car-details-view/SK60822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9f5d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_0c17d02b1992b9e3815a19e2a74829d0.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ead890>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_79edbdc9d47a88f8f332cdc04a2fe0e9.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_ede01c09b83560644e8260ae50793cea.jpg not downloaded yet
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_90c85d1d1e1700e5da91305bd757e13a.jpg not downloaded yet
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a351cc905de14145cb3db835face753.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8e6f9ce65d1d59b6fca5efc7700a1ba9.jpg not downloaded yet
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1cd50>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_ec30d8eecca5789f74f4263fbc41b921.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c855c0b3-e2b3-58a9-9fd6-863883939a49 with identifier: DG81101
2026-04-27 07:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c855c0b3-e2b3-58a9-9fd6-863883939a49 with scrape type 1
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_6cc07d72f718cffda8847f675a2b9318.jpg not downloaded yet
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ab190>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_30c0f2b211173ff32c6becfa420a14e9.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145f534e-44ad-59d9-ac16-4c2d63f1d99e with identifier: SK60822
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0bdeec51cface6c48db4b7960ee57865.jpg not downloaded yet
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_1fc1a759c5b6d17d2c58cb6199092018.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_281394e6d224dbb3f35d906427b35d04.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_16d483587c669ecae01631bc479c1ce8.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_f380cbd2b80d04e0390edecedd94eef2.jpg not downloaded yet
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_4e4a2ae590e421961f12cc987fba03d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_c488988618238414105e0bb41fea5447.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30043ad0>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a351cc905de14145cb3db835face753.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_b23db64b63671058f7006938e99ce038.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_2e888e79b5cdd6058fc4034365b2f462.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0e3eda1f2713fe87e5b3dfc0d0966d18.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_150409d88100bfd3be3c537a07b7fd69.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_07f74fc64d7fbd0ef592088d0e17d9f8.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_983e5cdad88487be758871193f4d4923.jpg not downloaded yet
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e8090>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_1fc1a759c5b6d17d2c58cb6199092018.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8bb78cfb60abb332289a4c082f5169d2.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_fc8d219a71b5b6f96b85cae94fa6ed12.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_2b5be3326c007b69b9dc750b7ed0d488.jpg not downloaded yet
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301670d0>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_4e4a2ae590e421961f12cc987fba03d7.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a690>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_c488988618238414105e0bb41fea5447.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_90c85d1d1e1700e5da91305bd757e13a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_6cc07d72f718cffda8847f675a2b9318.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0bdeec51cface6c48db4b7960ee57865.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW29882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ07980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8a692b7621de9a5d140351a47610d175.jpg not downloaded yet
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_5a31dbfc9b66b2702f8a4fb789569f6b.jpg not downloaded yet
2026-04-27 07:56:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_6fb04c8034c4122bc6c51c2af559a5c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_3e878d90f6913e0a561845b473618c30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_1ebc97b65ecc4ccaf32563ad02690b4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_a113366c9beca725e69d504ba244ad5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW86353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e990>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_90c85d1d1e1700e5da91305bd757e13a.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_fc8d219a71b5b6f96b85cae94fa6ed12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_5a31dbfc9b66b2702f8a4fb789569f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8d1d0>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_6cc07d72f718cffda8847f675a2b9318.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fa990>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0bdeec51cface6c48db4b7960ee57865.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_07f74fc64d7fbd0ef592088d0e17d9f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b06990>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_6fb04c8034c4122bc6c51c2af559a5c9.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d86c90>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_3e878d90f6913e0a561845b473618c30.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0610>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_1ebc97b65ecc4ccaf32563ad02690b4a.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 267161b4-3db5-5e00-a938-639dd7f3bc4b
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 267161b4-3db5-5e00-a938-639dd7f3bc4b, skipping ID generation
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267161b4-3db5-5e00-a938-639dd7f3bc4b with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 267161b4-3db5-5e00-a938-639dd7f3bc4b sending to next pipeline
2026-04-27 07:56:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267161b4-3db5-5e00-a938-639dd7f3bc4b, identifier: EX14210
2026-04-27 07:56:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a310>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_a113366c9beca725e69d504ba244ad5f.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_150409d88100bfd3be3c537a07b7fd69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_983e5cdad88487be758871193f4d4923.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267161b4-3db5-5e00-a938-639dd7f3bc4b with identifier: EX14210
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267161b4-3db5-5e00-a938-639dd7f3bc4b with identifier: EX14210
2026-04-27 07:56:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267161b4-3db5-5e00-a938-639dd7f3bc4b with identifier: EX14210 to the API
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_1ebc97b65ecc4ccaf32563ad02690b4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': 'Rental',
 'city': 'Germersheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:22:17Z',
 'fuel_type': 'petrol',
 'id': '267161b4-3db5-5e00-a938-639dd7f3bc4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX14210',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 102868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3268658,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_1ebc97b65ecc4ccaf32563ad02690b4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_e10c2e00c3452d4082277fa973e344ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3216e27a6b5788320fbf0dda86c32b30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_8a6675f23e42470c11a759b048d0a5f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_d2bbb00e6b87fc5a832f93d7a1945f90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_6fb04c8034c4122bc6c51c2af559a5c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_3568ce4ca6a114e6a9697d89b375431e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_c51c686d427f38ffc22b242bbc766a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_94c445924845744b481bb215020c683c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_267161b4-3db5-5e00-a938-639dd7f3bc4b/267161b4-3db5-5e00-a938-639dd7f3bc4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f8/3ef8ab2277391dc3397e5de222b23a9f/pa/EX14210_fb29c754c935cc758137f17c8eba6abf.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2018-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-04-27 07:56:55 [auto1.de] INFO: Saving data for EX14210: {'created_time': 1777276615.884291, 'last_price_update_time': 1777276615.884302, 'has_photos': True, 'auction_closing_time': 1777389737.0}
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_2b5be3326c007b69b9dc750b7ed0d488.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA43432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG61471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB89914> (referer: https://www.auto1.com/v1/car-details-view/NB89914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30259490>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_fc8d219a71b5b6f96b85cae94fa6ed12.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c11890>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_5a31dbfc9b66b2702f8a4fb789569f6b.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c1afd0>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_07f74fc64d7fbd0ef592088d0e17d9f8.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3c150>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_150409d88100bfd3be3c537a07b7fd69.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4ab50>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_983e5cdad88487be758871193f4d4923.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a83290>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_2b5be3326c007b69b9dc750b7ed0d488.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:56 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 10563 | hits on page: 40
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc996330-e011-5efd-b7fc-ecee1a0c3e04 with identifier: NB89914
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc996330-e011-5efd-b7fc-ecee1a0c3e04 with scrape type 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_87f3e61a0df38f286ca4f75b506904c2.jpg not downloaded yet
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: VN99537
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for VN99537: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: CR73975
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for CR73975: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: ZH89181
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for ZH89181: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: VV80524
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for VV80524: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: BP83751
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for BP83751: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: ZR44160
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: SG66334
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for SG66334: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: CY90259
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for CY90259: 0
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: VH19305
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for VH19305: 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_981a1f033c62a99a985637dc977d948d.jpg not downloaded yet
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8a692b7621de9a5d140351a47610d175.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8bb78cfb60abb332289a4c082f5169d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_16d483587c669ecae01631bc479c1ce8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_2e888e79b5cdd6058fc4034365b2f462.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD92686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_b23db64b63671058f7006938e99ce038.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: TU55462
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for TU55462: 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b31f3f51e394f068a4f1cc0dfd2c1901.jpg not downloaded yet
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_281394e6d224dbb3f35d906427b35d04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0e3eda1f2713fe87e5b3dfc0d0966d18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_f380cbd2b80d04e0390edecedd94eef2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: MU20643
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for MU20643: 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_81f07080bba5222d2d7d5ac0819b7683.jpg not downloaded yet
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_87f3e61a0df38f286ca4f75b506904c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: XT00440
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for XT00440: 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_3ee7129c1b9db853f86c4c880abccb53.jpg not downloaded yet
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8e6f9ce65d1d59b6fca5efc7700a1ba9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_ede01c09b83560644e8260ae50793cea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [auto1.de] INFO: Found listing with ID: BM19835
2026-04-27 07:56:56 [auto1.de] INFO: Scrape type for BM19835: 2
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with identifier: BM19835
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with scrape type 2
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec320e8f-8ea0-51df-bee2-67b2e9eb9177, identifier: BM19835
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b08c3d0d88c16e47ff97e76644706b1a.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with identifier: BM19835
2026-04-27 07:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with identifier: BM19835
2026-04-27 07:56:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec320e8f-8ea0-51df-bee2-67b2e9eb9177 with identifier: BM19835 to the API
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'city': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:06:05Z',
 'fuel_type': 'diesel',
 'id': 'ec320e8f-8ea0-51df-bee2-67b2e9eb9177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM19835',
 'listing': 'auction',
 'location_confidence': None,
 'longitude': None,
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 150759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'postal_code': None,
 'price': 0,
 'price_includes_vat': False,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L2 Trend',
 'transmission': 'manual',
 'trim': '290 L2 Trend',
 'year': 2016}
2026-04-27 07:56:57 [auto1.de] INFO: Saving data for BM19835: {'auction_closing_time': 1777388765.0, 'created_time': 1777028927.488343, 'has_photos': True, 'last_price_update_time': 1777276617.17874}
2026-04-27 07:56:57 [auto1.de] INFO: Found listing with ID: AA39826
2026-04-27 07:56:57 [auto1.de] INFO: Scrape type for AA39826: 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_99e02d2347e8184c2040769d581db1f3.jpg not downloaded yet
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e98750>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8a692b7621de9a5d140351a47610d175.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e62010>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8bb78cfb60abb332289a4c082f5169d2.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea3290>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_16d483587c669ecae01631bc479c1ce8.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30302c50>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_2e888e79b5cdd6058fc4034365b2f462.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c855c0b3-e2b3-58a9-9fd6-863883939a49
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c855c0b3-e2b3-58a9-9fd6-863883939a49, skipping ID generation
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c855c0b3-e2b3-58a9-9fd6-863883939a49 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c855c0b3-e2b3-58a9-9fd6-863883939a49 sending to next pipeline
2026-04-27 07:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c855c0b3-e2b3-58a9-9fd6-863883939a49, identifier: DG81101
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee9050>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_b23db64b63671058f7006938e99ce038.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_81f07080bba5222d2d7d5ac0819b7683.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b31f3f51e394f068a4f1cc0dfd2c1901.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_981a1f033c62a99a985637dc977d948d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_836d98ec7f60331823c1494716b9f52c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_26dc45e3862e363b6d66943b7f5fbe49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR46282> (referer: https://www.auto1.com/v1/car-details-view/LR46282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c855c0b3-e2b3-58a9-9fd6-863883939a49 with identifier: DG81101
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-04-27 07:56:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c855c0b3-e2b3-58a9-9fd6-863883939a49 with identifier: DG81101
2026-04-27 07:56:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c855c0b3-e2b3-58a9-9fd6-863883939a49 with identifier: DG81101 to the API
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_2e888e79b5cdd6058fc4034365b2f462.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'city': 'Greifswald',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:25:54Z',
 'fuel_type': 'petrol',
 'id': 'c855c0b3-e2b3-58a9-9fd6-863883939a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.0881,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG81101',
 'listing': 'auction',
 'location': 'Greifswald',
 'location_confidence': 'geocoded',
 'longitude': 13.3876,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 140979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_6cc07d72f718cffda8847f675a2b9318.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_16d483587c669ecae01631bc479c1ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_2e888e79b5cdd6058fc4034365b2f462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_07f74fc64d7fbd0ef592088d0e17d9f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_fc8d219a71b5b6f96b85cae94fa6ed12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c855c0b3-e2b3-58a9-9fd6-863883939a49/c855c0b3-e2b3-58a9-9fd6-863883939a49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/68/636802bb0e48a69e609398a6d86a7f0a/pa/DG81101_5a31dbfc9b66b2702f8a4fb789569f6b.jpg',
             'Width': 800}],
 'postal_code': '17489',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Mecklenburg-Vorpommern',
 'region_code': 'DE-MV',
 'registration_date': '2006-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-04-27 07:56:58 [auto1.de] INFO: Saving data for DG81101: {'created_time': 1777276618.723772, 'last_price_update_time': 1777276618.723788, 'has_photos': True, 'auction_closing_time': 1777389954.0}
2026-04-27 07:56:58 [auto1.de] INFO: Found listing with ID: FU39624
2026-04-27 07:56:58 [auto1.de] INFO: Scrape type for FU39624: 1
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_c70cfa3dd056115a3101363aec40ebf8.jpg not downloaded yet
2026-04-27 07:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d303028d0>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_281394e6d224dbb3f35d906427b35d04.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2aed0>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0e3eda1f2713fe87e5b3dfc0d0966d18.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30055210>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_f380cbd2b80d04e0390edecedd94eef2.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e
2026-04-27 07:56:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 145f534e-44ad-59d9-ac16-4c2d63f1d99e, skipping ID generation
2026-04-27 07:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e with scrape type 1
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 145f534e-44ad-59d9-ac16-4c2d63f1d99e sending to next pipeline
2026-04-27 07:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 145f534e-44ad-59d9-ac16-4c2d63f1d99e, identifier: SK60822
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce7ed0>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_87f3e61a0df38f286ca4f75b506904c2.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea150>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8e6f9ce65d1d59b6fca5efc7700a1ba9.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301afe50>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_ede01c09b83560644e8260ae50793cea.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb7e8e71-38ce-5d61-8446-2fa27a3a864e, skipping ID generation
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e with scrape type 1
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb7e8e71-38ce-5d61-8446-2fa27a3a864e sending to next pipeline
2026-04-27 07:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb7e8e71-38ce-5d61-8446-2fa27a3a864e, identifier: YK55062
2026-04-27 07:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 145f534e-44ad-59d9-ac16-4c2d63f1d99e with identifier: SK60822
2026-04-27 07:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 145f534e-44ad-59d9-ac16-4c2d63f1d99e with identifier: SK60822
2026-04-27 07:56:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 145f534e-44ad-59d9-ac16-4c2d63f1d99e with identifier: SK60822 to the API
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_f380cbd2b80d04e0390edecedd94eef2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Nordhausen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:35:36Z',
 'fuel_type': 'petrol',
 'id': '145f534e-44ad-59d9-ac16-4c2d63f1d99e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5018,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK60822',
 'listing': 'auction',
 'location': 'DE, Nordhausen',
 'location_confidence': 'geocoded',
 'longitude': 10.7957,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0bdeec51cface6c48db4b7960ee57865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_f380cbd2b80d04e0390edecedd94eef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_0e3eda1f2713fe87e5b3dfc0d0966d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_983e5cdad88487be758871193f4d4923.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_145f534e-44ad-59d9-ac16-4c2d63f1d99e/145f534e-44ad-59d9-ac16-4c2d63f1d99e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ef/c0efef990642637983edc77a2140da16/pa/SK60822_2b5be3326c007b69b9dc750b7ed0d488.jpg',
             'Width': 800}],
 'postal_code': '99734',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Thüringen',
 'region_code': 'DE-TH',
 'registration_date': '2011-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-04-27 07:56:59 [auto1.de] INFO: Saving data for SK60822: {'created_time': 1777276619.656933, 'last_price_update_time': 1777276619.656944, 'has_photos': True, 'auction_closing_time': 1777390536.0}
2026-04-27 07:56:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb7e8e71-38ce-5d61-8446-2fa27a3a864e with identifier: YK55062
2026-04-27 07:56:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb7e8e71-38ce-5d61-8446-2fa27a3a864e with identifier: YK55062
2026-04-27 07:56:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb7e8e71-38ce-5d61-8446-2fa27a3a864e with identifier: YK55062 to the API
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_ede01c09b83560644e8260ae50793cea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-04-28T15:40:28Z',
 'fuel_type': 'petrol',
 'id': 'eb7e8e71-38ce-5d61-8446-2fa27a3a864e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK55062',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 76065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_1fc1a759c5b6d17d2c58cb6199092018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_4e4a2ae590e421961f12cc987fba03d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_ede01c09b83560644e8260ae50793cea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_90c85d1d1e1700e5da91305bd757e13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8e6f9ce65d1d59b6fca5efc7700a1ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_281394e6d224dbb3f35d906427b35d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_b23db64b63671058f7006938e99ce038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_150409d88100bfd3be3c537a07b7fd69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8bb78cfb60abb332289a4c082f5169d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb7e8e71-38ce-5d61-8446-2fa27a3a864e/eb7e8e71-38ce-5d61-8446-2fa27a3a864e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e72158f36ab0b5b4a083dff060e13a/pa/YK55062_8a692b7621de9a5d140351a47610d175.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2020-11-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 TSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2020}
2026-04-27 07:57:00 [auto1.de] INFO: Saving data for YK55062: {'created_time': 1777276620.191573, 'last_price_update_time': 1777276620.191589, 'has_photos': True, 'auction_closing_time': 1777390828.0}
2026-04-27 07:57:00 [auto1.de] INFO: Found listing with ID: TS13333
2026-04-27 07:57:00 [auto1.de] INFO: Scrape type for TS13333: 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_91e02396a3e77eba18484bb6cc7584ac.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW29882> (referer: https://www.auto1.com/v1/car-details-view/EW29882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW86353> (referer: https://www.auto1.com/v1/car-details-view/JW86353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD36657> (referer: https://www.auto1.com/v1/car-details-view/JD36657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ07980> (referer: https://www.auto1.com/v1/car-details-view/KZ07980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f6710>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_81f07080bba5222d2d7d5ac0819b7683.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca2290>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b31f3f51e394f068a4f1cc0dfd2c1901.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75110>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_981a1f033c62a99a985637dc977d948d.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3290>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_836d98ec7f60331823c1494716b9f52c.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a4b38c3-ac5b-5540-9234-b1eacbe94697, skipping ID generation
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a4b38c3-ac5b-5540-9234-b1eacbe94697 sending to next pipeline
2026-04-27 07:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a4b38c3-ac5b-5540-9234-b1eacbe94697, identifier: CH70761
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee4f90>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_26dc45e3862e363b6d66943b7f5fbe49.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abb1bb63-2e88-523a-8950-82280b18c2a7
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abb1bb63-2e88-523a-8950-82280b18c2a7, skipping ID generation
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb1bb63-2e88-523a-8950-82280b18c2a7 with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abb1bb63-2e88-523a-8950-82280b18c2a7 sending to next pipeline
2026-04-27 07:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb1bb63-2e88-523a-8950-82280b18c2a7, identifier: PH76413
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd221311-ca2b-59d7-bb59-6ae349208bc4 with identifier: LR46282
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd221311-ca2b-59d7-bb59-6ae349208bc4 with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd221311-ca2b-59d7-bb59-6ae349208bc4
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0cedd2e10398d91cd54737e2653cceed.jpg not downloaded yet
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with identifier: CH70761
2026-04-27 07:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with identifier: CH70761
2026-04-27 07:57:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a4b38c3-ac5b-5540-9234-b1eacbe94697 with identifier: CH70761 to the API
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_836d98ec7f60331823c1494716b9f52c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:47:46Z',
 'fuel_type': 'diesel',
 'id': '0a4b38c3-ac5b-5540-9234-b1eacbe94697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH70761',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 42408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_836d98ec7f60331823c1494716b9f52c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a351cc905de14145cb3db835face753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_30c0f2b211173ff32c6becfa420a14e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_ec30d8eecca5789f74f4263fbc41b921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_96f1b5b874429eb0571636e7c30e4677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_6cb2ab5f6d4c1fd578e4b4c260fb7124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_2c4750d1005a8091ed8f748182f938f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_3eab97c4b659de058285abd99f1d10dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_1a24d0936e3c50665f856155e8e75e04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a4b38c3-ac5b-5540-9234-b1eacbe94697/0a4b38c3-ac5b-5540-9234-b1eacbe94697_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cb/52cb60fffe4002f749a55f6b4ef3d6d7/pa/CH70761_845f1b15456a6cda7112b991d22d3d4d.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Doppelkabine Limited 4x4',
 'year': 2019}
2026-04-27 07:57:01 [auto1.de] INFO: Saving data for CH70761: {'created_time': 1777276621.261133, 'last_price_update_time': 1777276621.261146, 'has_photos': True, 'auction_closing_time': 1777391266.0}
2026-04-27 07:57:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb1bb63-2e88-523a-8950-82280b18c2a7 with identifier: PH76413
2026-04-27 07:57:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb1bb63-2e88-523a-8950-82280b18c2a7 with identifier: PH76413
2026-04-27 07:57:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb1bb63-2e88-523a-8950-82280b18c2a7 with identifier: PH76413 to the API
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_26dc45e3862e363b6d66943b7f5fbe49.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'München',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:42:52Z',
 'fuel_type': 'petrol',
 'id': 'abb1bb63-2e88-523a-8950-82280b18c2a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.1345,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH76413',
 'listing': 'auction',
 'location': 'DE, München',
 'location_confidence': 'geocoded',
 'longitude': 11.571,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 111890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_26dc45e3862e363b6d66943b7f5fbe49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_c488988618238414105e0bb41fea5447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2567408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_a113366c9beca725e69d504ba244ad5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_0c17d02b1992b9e3815a19e2a74829d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_79edbdc9d47a88f8f332cdc04a2fe0e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_33bba400ec88c8b1252ecb4a4b078cbe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384791,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_3e878d90f6913e0a561845b473618c30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_999d1c3901b561d4e9899e363c26dbca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_b3c4453d28fd159bd28b6647c89e7d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_abb1bb63-2e88-523a-8950-82280b18c2a7/abb1bb63-2e88-523a-8950-82280b18c2a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4d/a64df55fd5b718265d9c2a5f62c38d25/pa/PH76413_822762849bf84856f421a1c0bf8f63a5.jpg',
             'Width': 2048}],
 'postal_code': '80331',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-04-27 07:57:01 [auto1.de] INFO: Saving data for PH76413: {'created_time': 1777276621.617892, 'last_price_update_time': 1777276621.617903, 'has_photos': True, 'auction_closing_time': 1777390972.0}
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b08c3d0d88c16e47ff97e76644706b1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_3ee7129c1b9db853f86c4c880abccb53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_99e02d2347e8184c2040769d581db1f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [auto1.de] INFO: Found listing with ID: SM15553
2026-04-27 07:57:01 [auto1.de] INFO: Scrape type for SM15553: 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_0274d9911fa982295aaed5920e7e677d.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_3761ff101818a8ec15a3c7dd531a78e8.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5528acf6-5b26-5f18-8a5a-343f05984673 with identifier: EW29882
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5528acf6-5b26-5f18-8a5a-343f05984673 with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5528acf6-5b26-5f18-8a5a-343f05984673
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_f7994fc9a17538a27148015df0d5f20d.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24 with identifier: JW86353
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24 with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_ef042eb38e7c7ed11e546eacfc327690.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1f3c6d3-a139-5b9d-ae85-a07810ad9523 with identifier: JD36657
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523 with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b7cd84a64cc2298d62d7fa17687c147b.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54814b1-937d-5607-b7a9-63ca75c33446 with identifier: KZ07980
2026-04-27 07:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54814b1-937d-5607-b7a9-63ca75c33446 with scrape type 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_4896e58802b318700958fb41078d0e5b.jpg not downloaded yet
2026-04-27 07:57:01 [auto1.de] INFO: Found listing with ID: AR94395
2026-04-27 07:57:01 [auto1.de] INFO: Scrape type for AR94395: 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_add8688e1e84517effcb754397e13327.jpg not downloaded yet
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG61471> (referer: https://www.auto1.com/v1/car-details-view/GG61471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA43432> (referer: https://www.auto1.com/v1/car-details-view/SA43432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH19305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_99e6ef5c5b2746d33e86aa7b7f4958c7.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_31e5945ebec97618298057f2ed598d78.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_4584db4b2ff866db66062eadcef9597d.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_5fb45c49da2794da34d5449a9181d04d.jpg not downloaded yet
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_c70cfa3dd056115a3101363aec40ebf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [auto1.de] INFO: Found listing with ID: ZS77255
2026-04-27 07:57:01 [auto1.de] INFO: Scrape type for ZS77255: 1
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_75c8025e84e200ba7ef00581a303eeef.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0cedd2e10398d91cd54737e2653cceed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_ba3f52eaed5020126feb1d575133f01b.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_d31139b992ce8b258000b0a5cc8ecc49.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b9fe5447c7b4333401fdac4a92fd3caf.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_1bf6de7b827c88f8a80b481a645fe8e2.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f10f10>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_b08c3d0d88c16e47ff97e76644706b1a.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea190>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_3ee7129c1b9db853f86c4c880abccb53.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4bed0>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_99e02d2347e8184c2040769d581db1f3.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:02 [auto1.de] INFO: Found listing with ID: WW54595
2026-04-27 07:57:02 [auto1.de] INFO: Scrape type for WW54595: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0ca1e79dfd7985c15b116cb5ae3118d8.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_4896e58802b318700958fb41078d0e5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_7c1e5a29da0addad58b8afd4080deed0.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_d61673a98a1000aed796fa260f891aaf.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_5505cc7df0b121e6a6f8614663280a5a.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_89922a89eda578cd020a8e352b195590.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_ef042eb38e7c7ed11e546eacfc327690.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b7cd84a64cc2298d62d7fa17687c147b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_91e02396a3e77eba18484bb6cc7584ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [auto1.de] INFO: Found listing with ID: PZ56265
2026-04-27 07:57:02 [auto1.de] INFO: Scrape type for PZ56265: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_672b9b31623356d5fd756f7795773435.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17577195-42c7-5f8b-9af4-b34090a1d43b with identifier: GG61471
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17577195-42c7-5f8b-9af4-b34090a1d43b with scrape type 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17577195-42c7-5f8b-9af4-b34090a1d43b
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_2d04f948044281635988a0f80ed8e04b.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95118c9e-1e60-598a-9caf-d3a4d96f0809 with identifier: SA43432
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95118c9e-1e60-598a-9caf-d3a4d96f0809 with scrape type 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_df937d27f117dbd332b888199c4aa020.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0090>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_c70cfa3dd056115a3101363aec40ebf8.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a54b50>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd221311-ca2b-59d7-bb59-6ae349208bc4/cd221311-ca2b-59d7-bb59-6ae349208bc4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0cedd2e10398d91cd54737e2653cceed.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd221311-ca2b-59d7-bb59-6ae349208bc4
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_add8688e1e84517effcb754397e13327.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_501288a4f98241c23c61d42577e5e9d8.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_9a0f2c0365353b4c8fd97296b3f1049f.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_5630cdd859f58c98d053c12d5a16caac.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_221f12f3f30af5e5cd2ffc7db5c07fa7.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_5fb45c49da2794da34d5449a9181d04d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [auto1.de] INFO: Found listing with ID: TB50006
2026-04-27 07:57:02 [auto1.de] INFO: Scrape type for TB50006: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_1debb0e33f58c644be62bca762d456c1.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_b7743dc5898ce797010e2d51cb6f3726.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_65054375e4f96fec90a42094a0179885.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_916773d8f67a2e3be2148b8180960582.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_0917636e16d0a07f2914dd8eaa077adc.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_8cfe50e64c73724c41077bfef9521d31.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_648d8ed0359d709ddc5abbf45d8bd04e.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f5b9d0>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_4896e58802b318700958fb41078d0e5b.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b86810>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24/8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_ef042eb38e7c7ed11e546eacfc327690.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eca7d0>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1f3c6d3-a139-5b9d-ae85-a07810ad9523/a1f3c6d3-a139-5b9d-ae85-a07810ad9523_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b7cd84a64cc2298d62d7fa17687c147b.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300cb290>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc996330-e011-5efd-b7fc-ecee1a0c3e04/bc996330-e011-5efd-b7fc-ecee1a0c3e04_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/1a/801a2eff4ac825173ebd616be65dd890/pa/NB89914_91e02396a3e77eba18484bb6cc7584ac.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc996330-e011-5efd-b7fc-ecee1a0c3e04
2026-04-27 07:57:02 [auto1.de] INFO: Found listing with ID: MY00361
2026-04-27 07:57:02 [auto1.de] INFO: Scrape type for MY00361: 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_5e72015c67e62419f65ec7fe9d26105a.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_9d64ab33c11bd418d73c2ccf572fa0ac.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_4c26ba184ec0e5424aa71bf3f5a1eade.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_1bf6de7b827c88f8a80b481a645fe8e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b9fe5447c7b4333401fdac4a92fd3caf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_89922a89eda578cd020a8e352b195590.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0ca1e79dfd7985c15b116cb5ae3118d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_5dccc2af3bfa3d71d913a79f64c99fb5.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_4f1f61aa1f36fa5f6dd87797aabfdf84.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_7c9f029183bdc25eeb335c5b549b488d.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301417d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd221311-ca2b-59d7-bb59-6ae349208bc4/cd221311-ca2b-59d7-bb59-6ae349208bc4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_add8688e1e84517effcb754397e13327.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd221311-ca2b-59d7-bb59-6ae349208bc4
2026-04-27 07:57:03 [auto1.de] INFO: Found listing with ID: CK72775
2026-04-27 07:57:03 [auto1.de] INFO: Scrape type for CK72775: 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_6c7e8e7ecb8eac2ce22dcd7c86b9ba38.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_d7a7c29ae0751f97299931955be28d65.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_ebd68c5cd475203924b17581e1801355.jpg not downloaded yet
2026-04-27 07:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_4162ff5c04f3f3fe6f7daaeb685fb5dc.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_d8e52ddd2b2c276b07d43a7bc950578e.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_c6b306a9b2b3360b1eecdb7269717b75.jpg not downloaded yet
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d0ed0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_5fb45c49da2794da34d5449a9181d04d.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:03 [auto1.de] INFO: Found listing with ID: XJ22163
2026-04-27 07:57:03 [auto1.de] INFO: Scrape type for XJ22163: 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_60a441ccd88a498f77140cda51354315.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_3d41a2767935deaa199177e055dc7f7f.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_3a9613197de4a0dde807d042d531200c.jpg not downloaded yet
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a722d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_1bf6de7b827c88f8a80b481a645fe8e2.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30142910>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1f3c6d3-a139-5b9d-ae85-a07810ad9523/a1f3c6d3-a139-5b9d-ae85-a07810ad9523_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_b9fe5447c7b4333401fdac4a92fd3caf.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eada90>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_89922a89eda578cd020a8e352b195590.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a810>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd221311-ca2b-59d7-bb59-6ae349208bc4/cd221311-ca2b-59d7-bb59-6ae349208bc4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_0ca1e79dfd7985c15b116cb5ae3118d8.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd221311-ca2b-59d7-bb59-6ae349208bc4
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_1e0b1d750f9f9d60573e95db4f0fbb66.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_24d1141257ea18fd1bbf98fe2e987b73.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_c8b91499f5743413aec1fdc1f401bb44.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_8cfe50e64c73724c41077bfef9521d31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_0917636e16d0a07f2914dd8eaa077adc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_916773d8f67a2e3be2148b8180960582.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [auto1.de] INFO: Found listing with ID: KX09123
2026-04-27 07:57:03 [auto1.de] INFO: Scrape type for KX09123: 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_85f45504e4a3e2b18a25b4783ad9a515.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_ff93b2a6a3066856b53563408b5fbbc4.jpg not downloaded yet
2026-04-27 07:57:03 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 10564 | hits on page: 40
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_648d8ed0359d709ddc5abbf45d8bd04e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_4c26ba184ec0e5424aa71bf3f5a1eade.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_2c1a59dd38070d0f2294a38d78f68297.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_961a362e42cb7716ebfa4dc2f09f77c7.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_8f779e20c5cfcac63f915c5a2fbf7c86.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT00440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU39624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU55462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [auto1.de] INFO: Found listing with ID: DJ38509
2026-04-27 07:57:03 [auto1.de] INFO: Scrape type for DJ38509: 1
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_70edf38390bc95fda5dd220b48a6b392.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_0a37c1c575657edb1a7fa8908c0bfb6e.jpg not downloaded yet
2026-04-27 07:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:03 [auto1.de] INFO: Found listing with ID: UF77020
2026-04-27 07:57:03 [auto1.de] INFO: Scrape type for UF77020: 1
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA39826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW29948> (referer: https://www.auto1.com/v1/car-details-view/WW29948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: KK79364
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for KK79364: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_11ac65dc937b9dafb19500d04ff316aa.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_f7bff8ca11a05a1a56d2c418e8c2cd3f.jpg not downloaded yet
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: BS13662
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for BS13662: 1
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_60a441ccd88a498f77140cda51354315.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_3d41a2767935deaa199177e055dc7f7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU20643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85050>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1f3c6d3-a139-5b9d-ae85-a07810ad9523/a1f3c6d3-a139-5b9d-ae85-a07810ad9523_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_8cfe50e64c73724c41077bfef9521d31.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016e610>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24/8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/1e/121eaa94b00209ac1de11a8599f174a7/pa/JW86353_0917636e16d0a07f2914dd8eaa077adc.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d97e6ee-8fe8-50ac-96bb-dd85e9d67e24
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22beb7d0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5528acf6-5b26-5f18-8a5a-343f05984673/5528acf6-5b26-5f18-8a5a-343f05984673_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/78/a478a25a55a6b15fc2dc815c4e52ad30/pa/EW29882_916773d8f67a2e3be2148b8180960582.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5528acf6-5b26-5f18-8a5a-343f05984673
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc40d0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_648d8ed0359d709ddc5abbf45d8bd04e.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41f10>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95118c9e-1e60-598a-9caf-d3a4d96f0809/95118c9e-1e60-598a-9caf-d3a4d96f0809_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_4c26ba184ec0e5424aa71bf3f5a1eade.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_3a9613197de4a0dde807d042d531200c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_c8b91499f5743413aec1fdc1f401bb44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: PU94869
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for PU94869: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_d70f1de8e7082d8db7d8651e0e4d6555.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_0ef97af3183edc71ce11b2c565dbcda9.jpg not downloaded yet
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: RY31497
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for RY31497: 1
2026-04-27 07:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_85f45504e4a3e2b18a25b4783ad9a515.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with identifier: WW29948
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_ff93b2a6a3066856b53563408b5fbbc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: WR52983
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for WR52983: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_698eb2c236d648b47d46f70d77dc4dcd.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_9e4ec6dcf56f9d0762391126f8a5dabc.jpg not downloaded yet
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: VB99238
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for VB99238: 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_d5c0db1391775922b8e893b4601e437b.jpg not downloaded yet
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d21d0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd221311-ca2b-59d7-bb59-6ae349208bc4/cd221311-ca2b-59d7-bb59-6ae349208bc4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/dd/bcdd417ace3f223a070a24964b2fda4f/pa/LR46282_60a441ccd88a498f77140cda51354315.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd221311-ca2b-59d7-bb59-6ae349208bc4
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30075f50>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17577195-42c7-5f8b-9af4-b34090a1d43b/17577195-42c7-5f8b-9af4-b34090a1d43b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_3d41a2767935deaa199177e055dc7f7f.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17577195-42c7-5f8b-9af4-b34090a1d43b
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: HC87215
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for HC87215: 1
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: HD70769
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for HD70769: 1
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_11ac65dc937b9dafb19500d04ff316aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_48edd2bfb888df5017a0a64afdb7a793.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_0a37c1c575657edb1a7fa8908c0bfb6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: XM76659
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for XM76659: 1
2026-04-27 07:57:04 [auto1.de] INFO: Found listing with ID: CP28896
2026-04-27 07:57:04 [auto1.de] INFO: Scrape type for CP28896: 1
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eeb5d0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95118c9e-1e60-598a-9caf-d3a4d96f0809/95118c9e-1e60-598a-9caf-d3a4d96f0809_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_3a9613197de4a0dde807d042d531200c.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028bcd0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c54814b1-937d-5607-b7a9-63ca75c33446/c54814b1-937d-5607-b7a9-63ca75c33446_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/20/1f208735ba6cb768a0a8a680c28c65a0/pa/KZ07980_c8b91499f5743413aec1fdc1f401bb44.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c54814b1-937d-5607-b7a9-63ca75c33446
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85dd0>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17577195-42c7-5f8b-9af4-b34090a1d43b/17577195-42c7-5f8b-9af4-b34090a1d43b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_85f45504e4a3e2b18a25b4783ad9a515.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17577195-42c7-5f8b-9af4-b34090a1d43b
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f2e90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95118c9e-1e60-598a-9caf-d3a4d96f0809/95118c9e-1e60-598a-9caf-d3a4d96f0809_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_ff93b2a6a3066856b53563408b5fbbc4.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1e63c3e79d02714bd7c0c00d6440a8be.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: LN16207
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for LN16207: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: AB85343
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for AB85343: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_0dc8d2d71f930758d678b7b75e8058ec.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f45490>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17577195-42c7-5f8b-9af4-b34090a1d43b/17577195-42c7-5f8b-9af4-b34090a1d43b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_11ac65dc937b9dafb19500d04ff316aa.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17577195-42c7-5f8b-9af4-b34090a1d43b
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5a050>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95118c9e-1e60-598a-9caf-d3a4d96f0809/95118c9e-1e60-598a-9caf-d3a4d96f0809_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_0a37c1c575657edb1a7fa8908c0bfb6e.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: ZF90785
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for ZF90785: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: MR57376
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for MR57376: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_bd95667ef01d8863b4f66e1d3241b11c.jpg not downloaded yet
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: YF83253
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for YF83253: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: HT44333
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for HT44333: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_1d9f223c9cac1f92dc62804737c2f101.jpg not downloaded yet
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: SC69744
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for SC69744: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: WH94807
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for WH94807: 1
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01e90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_020af8d947a17d6a1a6f1b8e83ca87f6.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_df6c28cb18986881f192d3932f7a2ef5.jpg not downloaded yet
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: NK94072
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for NK94072: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: EX50371
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for EX50371: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_a7cff11714e2d88b40bb55b03ef6b29c.jpg not downloaded yet
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: XL54193
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for XL54193: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: GF71499
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for GF71499: 1
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY48619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: CS60894
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for CS60894: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: YN27958
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for YN27958: 1
2026-04-27 07:57:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW54595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: UF77020
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: FC21553
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for FC21553: 1
2026-04-27 07:57:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH19305> (referer: https://www.auto1.com/v1/car-details-view/VH19305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: VX50427
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for VX50427: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: BU02227
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for BU02227: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: LE20823
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for LE20823: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: WH22056
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for WH22056: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: JR29139
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for JR29139: 1
2026-04-27 07:57:05 [auto1.de] INFO: Found listing with ID: TW15848
2026-04-27 07:57:05 [auto1.de] INFO: Scrape type for TW15848: 1
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_70edf38390bc95fda5dd220b48a6b392.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ38509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: NF69216
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for NF69216: 1
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0773ef3-ba2b-5e3a-88f9-602022870a1e with identifier: VH19305
2026-04-27 07:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0773ef3-ba2b-5e3a-88f9-602022870a1e with scrape type 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0773ef3-ba2b-5e3a-88f9-602022870a1e
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_e2795b4b236ccb7a44e906873439b612.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: DR46257
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for DR46257: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_803bf049d86e95f1c23b236615959c95.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30092310>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17577195-42c7-5f8b-9af4-b34090a1d43b/17577195-42c7-5f8b-9af4-b34090a1d43b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bd/e8bdd9e9dc746a9dac32215c5a1fea92/pa/GG61471_70edf38390bc95fda5dd220b48a6b392.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17577195-42c7-5f8b-9af4-b34090a1d43b
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: TS90564
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for TS90564: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_3e965039bb34f35e5f2805c039ada803.jpg not downloaded yet
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a61350>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e049d29-d9e5-5ea2-a88b-27625cbf2cdd/5e049d29-d9e5-5ea2-a88b-27625cbf2cdd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/60/9260aafd23724be97dfc444f2e7d260a/pa/WW29948_2b9bc2341d9080148f1db2aacd7ce998.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e049d29-d9e5-5ea2-a88b-27625cbf2cdd
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: EC78476
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for EC78476: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_72afc4e81458b6a446bb2f84d846d606.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_24d1141257ea18fd1bbf98fe2e987b73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: GG24255
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for GG24255: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_910cf970f5d2aefd67ccfa4043c6395a.jpg not downloaded yet
2026-04-27 07:57:06 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 10564 | hits on page: 40
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF77020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: AG43017
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for AG43017: 1
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_d6e848b57a57247dec0a8816edcc2edb.jpg not downloaded yet
2026-04-27 07:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: XA47491
2026-04-27 07:57:06 [auto1.de] INFO: Scrape type for XA47491: 1
2026-04-27 07:57:06 [auto1.de] INFO: Found listing with ID: PS73688
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for PS73688: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_28fd7a19de6a2cce4f9f9881b01360b1.jpg not downloaded yet
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: LK77652
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for LK77652: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: PJ27093
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for PJ27093: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_d0d1854c564225a98e87922be7994715.jpg not downloaded yet
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: DS42443
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for DS42443: 1
2026-04-27 07:57:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea810>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1f3c6d3-a139-5b9d-ae85-a07810ad9523/a1f3c6d3-a139-5b9d-ae85-a07810ad9523_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/41/fb41cb812a886d9798bf9e63cd006a73/pa/JD36657_24d1141257ea18fd1bbf98fe2e987b73.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1f3c6d3-a139-5b9d-ae85-a07810ad9523
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_72afc4e81458b6a446bb2f84d846d606.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: TD77492
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for TD77492: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_3b6b28cf8dcc6765944c00c7a234876f.jpg not downloaded yet
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: EK77340
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for EK77340: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_f7bff8ca11a05a1a56d2c418e8c2cd3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: PV80751
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for PV80751: 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_9eea8e75687376d2a47b7b13347a8bf2.jpg not downloaded yet
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: UZ78249
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for UZ78249: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: HT03152
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for HT03152: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: ZS80783
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for ZS80783: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: KA93370
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for KA93370: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: XJ62063
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for XJ62063: 1
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028cf10>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0773ef3-ba2b-5e3a-88f9-602022870a1e/b0773ef3-ba2b-5e3a-88f9-602022870a1e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_72afc4e81458b6a446bb2f84d846d606.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0773ef3-ba2b-5e3a-88f9-602022870a1e
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: SZ55877
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for SZ55877: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: TF44325
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for TF44325: 1
2026-04-27 07:57:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8e010>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95118c9e-1e60-598a-9caf-d3a4d96f0809/95118c9e-1e60-598a-9caf-d3a4d96f0809_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/de/f9decf08b03eb779a97fe0d727f23a3e/pa/SA43432_f7bff8ca11a05a1a56d2c418e8c2cd3f.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95118c9e-1e60-598a-9caf-d3a4d96f0809
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: FL10476
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for FL10476: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: UM20037
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for UM20037: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: LB57303
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for LB57303: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: WK31693
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for WK31693: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS13662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: XF53858
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for XF53858: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: WT98226
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for WT98226: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: YX24821
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for YX24821: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: KR08118
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for KR08118: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK79364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: RE55796
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for RE55796: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: MR74819
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for MR74819: 1
2026-04-27 07:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: LF31968
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for LF31968: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: CG08115
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for CG08115: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP28896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: EC79074
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for EC79074: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: VX68221
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for VX68221: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: PD98711
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for PD98711: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC87215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: FZ65862
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for FZ65862: 1
2026-04-27 07:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: BY14465
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for BY14465: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: TM06775
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for TM06775: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: NK69314
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for NK69314: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: HN24396
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for HN24396: 1
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_e2795b4b236ccb7a44e906873439b612.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: VS15824
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for VS15824: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: CR24268
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for CR24268: 1
2026-04-27 07:57:07 [auto1.de] INFO: Found listing with ID: UF78071
2026-04-27 07:57:07 [auto1.de] INFO: Scrape type for UF78071: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: MV81221
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for MV81221: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: UC51546
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for UC51546: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: YM11561
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for YM11561: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: LK12622
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for LK12622: 1
2026-04-27 07:57:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b334d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0773ef3-ba2b-5e3a-88f9-602022870a1e/b0773ef3-ba2b-5e3a-88f9-602022870a1e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/3b/2a3b767fa7c0dba7a5fb529d3ad95517/pa/VH19305_e2795b4b236ccb7a44e906873439b612.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0773ef3-ba2b-5e3a-88f9-602022870a1e
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: FZ02715
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for FZ02715: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: PS74193
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for PS74193: 1
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN27958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: XY65669
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for XY65669: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: PD54175
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for PD54175: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: AW88722
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for AW88722: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: YM33158
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for YM33158: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: KP49252
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for KP49252: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: ZX15203
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for ZX15203: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: XV72554
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for XV72554: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: ND34621
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for ND34621: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: DF16911
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for DF16911: 1
2026-04-27 07:57:08 [auto1.de] INFO: Found listing with ID: ZZ83699
2026-04-27 07:57:08 [auto1.de] INFO: Scrape type for ZZ83699: 1
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD70769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS13333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD92686> (referer: https://www.auto1.com/v1/car-details-view/CD92686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c45cbfce-ad06-5f74-8ffd-d1038acf1479 with identifier: CD92686
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45cbfce-ad06-5f74-8ffd-d1038acf1479 with scrape type 1
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_7ba6aa18b3d468cff1f911e2c69a537a.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_70f681e962046a4b976100103411d969.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_754fec7d80e7cc8df4cbb3aa28b4496f.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_4efc6f84e7b3d600015592af1ec29863.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3b3ddca4d1b70ffe2e3ec63970cacb13.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3e726d3d828ac8f06802eaee42da4af9.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_803f2f1333d2d47ad4ccdb12941d9755.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3136d1ab13199b08fa1cf3a720a1acfb.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_43b0a8933d3e5b1e8e6e5f62cd58c347.jpg not downloaded yet
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_c40ac07d1e8d0d9baa013b5095629730.jpg not downloaded yet
2026-04-27 07:57:43 [scrapy.extensions.logstats] INFO: Crawled 302 pages (at 39 pages/min), scraped 121 items (at 18 items/min)
2026-04-27 07:57:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 07:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS42443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_c40ac07d1e8d0d9baa013b5095629730.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179890>
2026-04-27 07:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_c40ac07d1e8d0d9baa013b5095629730.jpg saved to cache
2026-04-27 07:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW15848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_43b0a8933d3e5b1e8e6e5f62cd58c347.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3136d1ab13199b08fa1cf3a720a1acfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8150>
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_43b0a8933d3e5b1e8e6e5f62cd58c347.jpg saved to cache
2026-04-27 07:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b590>
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3136d1ab13199b08fa1cf3a720a1acfb.jpg saved to cache
2026-04-27 07:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:15 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 10571 | hits on page: 40
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: YM33158
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: KP49252
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: ZX15203
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: XV72554
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: ND34621
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: DF16911
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: ZZ83699
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: MS52892
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for MS52892: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: LT57344
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for LT57344: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: GJ77408
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for GJ77408: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: WK50134
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for WK50134: 1
2026-04-27 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_803f2f1333d2d47ad4ccdb12941d9755.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: SP61181
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for SP61181: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: ND93415
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for ND93415: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: DY50471
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for DY50471: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: BB27376
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for BB27376: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: YJ43291
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for YJ43291: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: ZT46165
2026-04-27 07:58:15 [auto1.de] INFO: Scrape type for ZT46165: 1
2026-04-27 07:58:15 [auto1.de] INFO: Found listing with ID: NS01283
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for NS01283: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: BB12781
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for BB12781: 1
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c35390>
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_803f2f1333d2d47ad4ccdb12941d9755.jpg saved to cache
2026-04-27 07:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: JL60015
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for JL60015: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: GH56807
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for GH56807: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: VR97346
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for VR97346: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: WL82940
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for WL82940: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: LU46905
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for LU46905: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: AV27190
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for AV27190: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: BH77652
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for BH77652: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: ED54075
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for ED54075: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: KU34355
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for KU34355: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: PB76196
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for PB76196: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: PF85631
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for PF85631: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: LS10093
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for LS10093: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: VY08054
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for VY08054: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: RV47209
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for RV47209: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: HT72839
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for HT72839: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: ML65322
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for ML65322: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: FN19474
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for FN19474: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: FE77695
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for FE77695: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: PW12132
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for PW12132: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: EK13927
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for EK13927: 1
2026-04-27 07:58:16 [auto1.de] INFO: Found listing with ID: WP87454
2026-04-27 07:58:16 [auto1.de] INFO: Scrape type for WP87454: 1
2026-04-27 07:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR74819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP28896> (referer: https://www.auto1.com/v1/car-details-view/CP28896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-04-27 07:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6652cb6-b324-5873-af8d-3d8ab3642cf8 with scrape type 1
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_68e00d1d5589fbde1a1ef1036e0c2ab4.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_c20b4d022bc1e729e2669eec3ccb9e1a.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_fefbf168222f7fe97d32d17c2ac01943.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_b7e638f0a5538e3e6f21e90cf1e9debb.jpg not downloaded yet
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_e0b611eed98d0fcd1010d322dc9faee6.jpg not downloaded yet
2026-04-27 07:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK77340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_e0b611eed98d0fcd1010d322dc9faee6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_b7e638f0a5538e3e6f21e90cf1e9debb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0a150>
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_e0b611eed98d0fcd1010d322dc9faee6.jpg saved to cache
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c29a10>
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_b7e638f0a5538e3e6f21e90cf1e9debb.jpg saved to cache
2026-04-27 07:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ83699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_fefbf168222f7fe97d32d17c2ac01943.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_c20b4d022bc1e729e2669eec3ccb9e1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea7d0>
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_fefbf168222f7fe97d32d17c2ac01943.jpg saved to cache
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030b1d0>
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_c20b4d022bc1e729e2669eec3ccb9e1a.jpg saved to cache
2026-04-27 07:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD70769> (referer: https://www.auto1.com/v1/car-details-view/HD70769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_68e00d1d5589fbde1a1ef1036e0c2ab4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with identifier: HD70769
2026-04-27 07:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with scrape type 1
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_7f4e2bb4ca16099603a94aea08b6e1f4.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6c1da61ec5ff72c73b8c4fcdce12b8b1.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_97c812b7d7b5d313b1b4901e21ad0856.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6672832ab28db8648fcb1c68026420ef.jpg not downloaded yet
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_2a1e76edbba130745b9b1a01f264d5eb.jpg not downloaded yet
2026-04-27 07:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0ae90>
2026-04-27 07:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_68e00d1d5589fbde1a1ef1036e0c2ab4.jpg saved to cache
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6652cb6-b324-5873-af8d-3d8ab3642cf8
2026-04-27 07:58:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6652cb6-b324-5873-af8d-3d8ab3642cf8, skipping ID generation
2026-04-27 07:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6652cb6-b324-5873-af8d-3d8ab3642cf8 with scrape type 1
2026-04-27 07:58:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6652cb6-b324-5873-af8d-3d8ab3642cf8 sending to next pipeline
2026-04-27 07:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6652cb6-b324-5873-af8d-3d8ab3642cf8, identifier: CP28896
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_0dc1f986e6d16831b9651fe78614e6b6.jpg not downloaded yet
2026-04-27 07:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-04-27 07:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-04-27 07:58:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896 to the API
2026-04-27 07:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_68e00d1d5589fbde1a1ef1036e0c2ab4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'city': 'Seddiner See',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:04:25Z',
 'fuel_type': 'petrol',
 'id': 'a6652cb6-b324-5873-af8d-3d8ab3642cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP28896',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 194565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_68e00d1d5589fbde1a1ef1036e0c2ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_c20b4d022bc1e729e2669eec3ccb9e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_fefbf168222f7fe97d32d17c2ac01943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_b7e638f0a5538e3e6f21e90cf1e9debb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6652cb6-b324-5873-af8d-3d8ab3642cf8/a6652cb6-b324-5873-af8d-3d8ab3642cf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9d/a79d999f684a20baa1956260056d3936/pa/CP28896_e0b611eed98d0fcd1010d322dc9faee6.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2003-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Special 4x4',
 'transmission': 'manual',
 'trim': 'Special 4x4',
 'year': 2003}
2026-04-27 07:58:25 [auto1.de] INFO: Saving data for CP28896: {'created_time': 1777276705.586185, 'last_price_update_time': 1777276705.586195, 'has_photos': True, 'auction_closing_time': 1777388665.0}
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_1bc8a496b4efb6d5392389e19bd30bc8.jpg not downloaded yet
2026-04-27 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD98711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_a3154c825358f4ef05f440ec8497bc47.jpg not downloaded yet
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_8acbc2e1c036c8cd62d36ca29a7a4425.jpg not downloaded yet
2026-04-27 07:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_b564037f334843bb437728d38700a2a4.jpg not downloaded yet
2026-04-27 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_0dc1f986e6d16831b9651fe78614e6b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b81150>
2026-04-27 07:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_0dc1f986e6d16831b9651fe78614e6b6.jpg saved to cache
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK31693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_b564037f334843bb437728d38700a2a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_8acbc2e1c036c8cd62d36ca29a7a4425.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_a3154c825358f4ef05f440ec8497bc47.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b4d0>
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_b564037f334843bb437728d38700a2a4.jpg saved to cache
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b85f90>
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_8acbc2e1c036c8cd62d36ca29a7a4425.jpg saved to cache
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a23810>
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_a3154c825358f4ef05f440ec8497bc47.jpg saved to cache
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS42443> (referer: https://www.auto1.com/v1/car-details-view/DS42443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ea7d16-cf85-58da-862f-9d43199d007b with identifier: DS42443
2026-04-27 07:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ea7d16-cf85-58da-862f-9d43199d007b with scrape type 1
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_310c583f0688fe9710cecc8e316248d9.jpg not downloaded yet
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_0a78a9ea23f1309edaeb3115accb1375.jpg not downloaded yet
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_62a1c0b9a12cfa95e4c65d17e9a461ef.jpg not downloaded yet
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_1bc8a496b4efb6d5392389e19bd30bc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_1c89625800a891a06dc50ddf6380f67a.jpg not downloaded yet
2026-04-27 07:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_8d1467a8ad0434eba183dd9ec535151a.jpg not downloaded yet
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_62a1c0b9a12cfa95e4c65d17e9a461ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b84e90>
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_1bc8a496b4efb6d5392389e19bd30bc8.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_8d1467a8ad0434eba183dd9ec535151a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c29410>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_62a1c0b9a12cfa95e4c65d17e9a461ef.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_1c89625800a891a06dc50ddf6380f67a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30290390>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_8d1467a8ad0434eba183dd9ec535151a.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_0a78a9ea23f1309edaeb3115accb1375.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_310c583f0688fe9710cecc8e316248d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c21fd0>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_1c89625800a891a06dc50ddf6380f67a.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc0150>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_0a78a9ea23f1309edaeb3115accb1375.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f2cd0>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_310c583f0688fe9710cecc8e316248d9.jpg saved to cache
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30ea7d16-cf85-58da-862f-9d43199d007b
2026-04-27 07:58:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30ea7d16-cf85-58da-862f-9d43199d007b, skipping ID generation
2026-04-27 07:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ea7d16-cf85-58da-862f-9d43199d007b with scrape type 1
2026-04-27 07:58:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30ea7d16-cf85-58da-862f-9d43199d007b sending to next pipeline
2026-04-27 07:58:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30ea7d16-cf85-58da-862f-9d43199d007b, identifier: DS42443
2026-04-27 07:58:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30ea7d16-cf85-58da-862f-9d43199d007b with identifier: DS42443
2026-04-27 07:58:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30ea7d16-cf85-58da-862f-9d43199d007b with identifier: DS42443
2026-04-27 07:58:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30ea7d16-cf85-58da-862f-9d43199d007b with identifier: DS42443 to the API
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_310c583f0688fe9710cecc8e316248d9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Buch',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:21:44Z',
 'fuel_type': 'diesel',
 'id': '30ea7d16-cf85-58da-862f-9d43199d007b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS42443',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 188831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_310c583f0688fe9710cecc8e316248d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_0a78a9ea23f1309edaeb3115accb1375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_62a1c0b9a12cfa95e4c65d17e9a461ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_1c89625800a891a06dc50ddf6380f67a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_30ea7d16-cf85-58da-862f-9d43199d007b/30ea7d16-cf85-58da-862f-9d43199d007b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e7/d7e7c036c2a15e0386161daea3cdad85/pa/DS42443_8d1467a8ad0434eba183dd9ec535151a.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2004-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Transit 2.4 TDE FT 330 Mittel',
 'transmission': 'manual',
 'trim': 'FT 330 Mittel',
 'year': 2004}
2026-04-27 07:58:28 [auto1.de] INFO: Saving data for DS42443: {'created_time': 1777276708.850944, 'last_price_update_time': 1777276708.850955, 'has_photos': True, 'auction_closing_time': 1777389704.0}
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_2a1e76edbba130745b9b1a01f264d5eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS13333> (referer: https://www.auto1.com/v1/car-details-view/TS13333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW15848> (referer: https://www.auto1.com/v1/car-details-view/TW15848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6672832ab28db8648fcb1c68026420ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_7f4e2bb4ca16099603a94aea08b6e1f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f3650>
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_2a1e76edbba130745b9b1a01f264d5eb.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-04-27 07:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with scrape type 1
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_59c716f556ed89fde53de914e830e5bc.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-04-27 07:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 1
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4ebb344430a5e0ed2746c796355ff497.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_b3d96d53d991a081693c8c79299d1eb3.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_e593d39c8d74756d81ec3110a491e65f.jpg not downloaded yet
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6c1da61ec5ff72c73b8c4fcdce12b8b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_4bc41ac64f8e88229bf2bf8c9ea89508.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_3c01e821c9a10508dcea00635a6e6133.jpg not downloaded yet
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042050>
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6672832ab28db8648fcb1c68026420ef.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cac510>
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_7f4e2bb4ca16099603a94aea08b6e1f4.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_97c812b7d7b5d313b1b4901e21ad0856.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_bd9dc982c91d21082f76d8daafbb7720.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_04b8da27a74f9628014ee44f19943cf2.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_14d7565dca4dc0c3d5c86bd9d2d6bf0c.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_f202b56c46a4ffee18491bb5fb2b35e3.jpg not downloaded yet
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecf750>
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6c1da61ec5ff72c73b8c4fcdce12b8b1.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_6973555003a39853edbe600a0e9a5d6a.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_220e5a69cff63b488326a7c95daad92d.jpg not downloaded yet
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_e593d39c8d74756d81ec3110a491e65f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_3c01e821c9a10508dcea00635a6e6133.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_ac1070de61fde3c437b70038e167e94c.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4a0b61c9ab3a506aefe572017d9b6154.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_17becc507992a1342f17c17431dfede6.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_9223e54038350726448010fbf3456d87.jpg not downloaded yet
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2010>
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_97c812b7d7b5d313b1b4901e21ad0856.jpg saved to cache
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5
2026-04-27 07:58:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a18c3e4b-6658-5d07-8090-8734e3d5e2a5, skipping ID generation
2026-04-27 07:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with scrape type 1
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a18c3e4b-6658-5d07-8090-8734e3d5e2a5 sending to next pipeline
2026-04-27 07:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a18c3e4b-6658-5d07-8090-8734e3d5e2a5, identifier: HD70769
2026-04-27 07:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with identifier: HD70769
2026-04-27 07:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with identifier: HD70769
2026-04-27 07:58:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a18c3e4b-6658-5d07-8090-8734e3d5e2a5 with identifier: HD70769 to the API
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_97c812b7d7b5d313b1b4901e21ad0856.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:12:38Z',
 'fuel_type': 'petrol',
 'id': 'a18c3e4b-6658-5d07-8090-8734e3d5e2a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD70769',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 115961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_7f4e2bb4ca16099603a94aea08b6e1f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6c1da61ec5ff72c73b8c4fcdce12b8b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_97c812b7d7b5d313b1b4901e21ad0856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_6672832ab28db8648fcb1c68026420ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_2a1e76edbba130745b9b1a01f264d5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_0dc1f986e6d16831b9651fe78614e6b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_1bc8a496b4efb6d5392389e19bd30bc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_a3154c825358f4ef05f440ec8497bc47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_8acbc2e1c036c8cd62d36ca29a7a4425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a18c3e4b-6658-5d07-8090-8734e3d5e2a5/a18c3e4b-6658-5d07-8090-8734e3d5e2a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfb9f3a9c6aa384abcd2454a269b02/pa/HD70769_b564037f334843bb437728d38700a2a4.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2012}
2026-04-27 07:58:29 [auto1.de] INFO: Saving data for HD70769: {'created_time': 1777276709.794307, 'last_price_update_time': 1777276709.794317, 'has_photos': True, 'auction_closing_time': 1777389158.0}
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_e38646514786c75bc043d43c8e3cb2ee.jpg not downloaded yet
2026-04-27 07:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_fd0fa0c4406c36fe8389d9e5f6ff63bc.jpg not downloaded yet
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_f202b56c46a4ffee18491bb5fb2b35e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_14d7565dca4dc0c3d5c86bd9d2d6bf0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_70a7ca5a08be71f8a01b14a039455d03.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_63edb737f4128123bb7eb7d5f0260083.jpg not downloaded yet
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32099390>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_e593d39c8d74756d81ec3110a491e65f.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fb010>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_3c01e821c9a10508dcea00635a6e6133.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR74819> (referer: https://www.auto1.com/v1/car-details-view/MR74819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85c50>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_f202b56c46a4ffee18491bb5fb2b35e3.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f5b610>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_14d7565dca4dc0c3d5c86bd9d2d6bf0c.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_fd0fa0c4406c36fe8389d9e5f6ff63bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_e38646514786c75bc043d43c8e3cb2ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705cd35e-a4d8-526e-ab46-a0d66e281b96 with identifier: MR74819
2026-04-27 07:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705cd35e-a4d8-526e-ab46-a0d66e281b96 with scrape type 1
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_3478b6247a1138d210b96ef4648645d4.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_0ca1178b950c10a815d4504feb0a066d.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_a3aa91afb99fe6bd827da4da5b3db6a4.jpg not downloaded yet
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_9223e54038350726448010fbf3456d87.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_70a7ca5a08be71f8a01b14a039455d03.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_63edb737f4128123bb7eb7d5f0260083.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_349c6fe5ba63e22fe7030c852637c469.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_110cdb4de1f52c38b22298e5f73ed286.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_e095b998bb40eda62de471322f992d59.jpg not downloaded yet
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecd390>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_fd0fa0c4406c36fe8389d9e5f6ff63bc.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcc950>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_e38646514786c75bc043d43c8e3cb2ee.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_4590a52c47523d4e4fb7a1f910b14a24.jpg not downloaded yet
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_3478b6247a1138d210b96ef4648645d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_a3aa91afb99fe6bd827da4da5b3db6a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_0ca1178b950c10a815d4504feb0a066d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_9d0c04abfb9bd2d84b6b5d02476a8abd.jpg not downloaded yet
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd6490>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_9223e54038350726448010fbf3456d87.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cf98d0>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_70a7ca5a08be71f8a01b14a039455d03.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09690>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_63edb737f4128123bb7eb7d5f0260083.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_ab7b64e02b0151c1cf99c0a4d857bed6.jpg not downloaded yet
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_2f5993af02b538de428cb5b15ddef3c6.jpg not downloaded yet
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30092f10>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_3478b6247a1138d210b96ef4648645d4.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7b850>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_a3aa91afb99fe6bd827da4da5b3db6a4.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f5250>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_0ca1178b950c10a815d4504feb0a066d.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_e095b998bb40eda62de471322f992d59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_110cdb4de1f52c38b22298e5f73ed286.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_4590a52c47523d4e4fb7a1f910b14a24.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_9d0c04abfb9bd2d84b6b5d02476a8abd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b6550>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_e095b998bb40eda62de471322f992d59.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09810>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_110cdb4de1f52c38b22298e5f73ed286.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e8dd50>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_4590a52c47523d4e4fb7a1f910b14a24.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_2f5993af02b538de428cb5b15ddef3c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_ab7b64e02b0151c1cf99c0a4d857bed6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cfa790>
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_9d0c04abfb9bd2d84b6b5d02476a8abd.jpg saved to cache
2026-04-27 07:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_349c6fe5ba63e22fe7030c852637c469.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_ac1070de61fde3c437b70038e167e94c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c24950>
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_2f5993af02b538de428cb5b15ddef3c6.jpg saved to cache
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30178050>
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_ab7b64e02b0151c1cf99c0a4d857bed6.jpg saved to cache
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_220e5a69cff63b488326a7c95daad92d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad110>
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_349c6fe5ba63e22fe7030c852637c469.jpg saved to cache
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 705cd35e-a4d8-526e-ab46-a0d66e281b96
2026-04-27 07:58:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 705cd35e-a4d8-526e-ab46-a0d66e281b96, skipping ID generation
2026-04-27 07:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705cd35e-a4d8-526e-ab46-a0d66e281b96 with scrape type 1
2026-04-27 07:58:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 705cd35e-a4d8-526e-ab46-a0d66e281b96 sending to next pipeline
2026-04-27 07:58:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 705cd35e-a4d8-526e-ab46-a0d66e281b96, identifier: MR74819
2026-04-27 07:58:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 705cd35e-a4d8-526e-ab46-a0d66e281b96 with identifier: MR74819
2026-04-27 07:58:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 705cd35e-a4d8-526e-ab46-a0d66e281b96 with identifier: MR74819
2026-04-27 07:58:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 705cd35e-a4d8-526e-ab46-a0d66e281b96 with identifier: MR74819 to the API
2026-04-27 07:58:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_349c6fe5ba63e22fe7030c852637c469.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Schkopau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:47:02Z',
 'fuel_type': 'petrol',
 'id': '705cd35e-a4d8-526e-ab46-a0d66e281b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR74819',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 27373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_3478b6247a1138d210b96ef4648645d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_0ca1178b950c10a815d4504feb0a066d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_a3aa91afb99fe6bd827da4da5b3db6a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_349c6fe5ba63e22fe7030c852637c469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_110cdb4de1f52c38b22298e5f73ed286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_e095b998bb40eda62de471322f992d59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_4590a52c47523d4e4fb7a1f910b14a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_9d0c04abfb9bd2d84b6b5d02476a8abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_ab7b64e02b0151c1cf99c0a4d857bed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_705cd35e-a4d8-526e-ab46-a0d66e281b96/705cd35e-a4d8-526e-ab46-a0d66e281b96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/ed/f4edcd05dd405403c35ef78408ccb03c/pa/MR74819_2f5993af02b538de428cb5b15ddef3c6.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2015}
2026-04-27 07:58:33 [auto1.de] INFO: Saving data for MR74819: {'created_time': 1777276713.119629, 'last_price_update_time': 1777276713.119638, 'has_photos': True, 'auction_closing_time': 1777391222.0}
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4a0b61c9ab3a506aefe572017d9b6154.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_17becc507992a1342f17c17431dfede6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_6973555003a39853edbe600a0e9a5d6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea090>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_ac1070de61fde3c437b70038e167e94c.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a117d0>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_220e5a69cff63b488326a7c95daad92d.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_bd9dc982c91d21082f76d8daafbb7720.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_04b8da27a74f9628014ee44f19943cf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7e50d0>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4a0b61c9ab3a506aefe572017d9b6154.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c1950>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_17becc507992a1342f17c17431dfede6.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4ebb344430a5e0ed2746c796355ff497.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_4bc41ac64f8e88229bf2bf8c9ea89508.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46c50>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_6973555003a39853edbe600a0e9a5d6a.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1cf10>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_bd9dc982c91d21082f76d8daafbb7720.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3f10>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_04b8da27a74f9628014ee44f19943cf2.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_b3d96d53d991a081693c8c79299d1eb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1a90>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4ebb344430a5e0ed2746c796355ff497.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8097b80-dd32-5c15-9311-e37f7ab126b1
2026-04-27 07:58:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8097b80-dd32-5c15-9311-e37f7ab126b1, skipping ID generation
2026-04-27 07:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 1
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8097b80-dd32-5c15-9311-e37f7ab126b1 sending to next pipeline
2026-04-27 07:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8097b80-dd32-5c15-9311-e37f7ab126b1, identifier: TW15848
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ada10>
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_4bc41ac64f8e88229bf2bf8c9ea89508.jpg saved to cache
2026-04-27 07:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-04-27 07:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-04-27 07:58:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848 to the API
2026-04-27 07:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4ebb344430a5e0ed2746c796355ff497.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'e8097b80-dd32-5c15-9311-e37f7ab126b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15848',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'BMW',
 'model': '5er',
 'odometer': 192905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4ebb344430a5e0ed2746c796355ff497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_e593d39c8d74756d81ec3110a491e65f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_3c01e821c9a10508dcea00635a6e6133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_04b8da27a74f9628014ee44f19943cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_f202b56c46a4ffee18491bb5fb2b35e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_220e5a69cff63b488326a7c95daad92d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_4a0b61c9ab3a506aefe572017d9b6154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_9223e54038350726448010fbf3456d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_fd0fa0c4406c36fe8389d9e5f6ff63bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8097b80-dd32-5c15-9311-e37f7ab126b1/e8097b80-dd32-5c15-9311-e37f7ab126b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/08/a708159550c1effd968f06ce301dd559/pa/TW15848_63edb737f4128123bb7eb7d5f0260083.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-04-27 07:58:34 [auto1.de] INFO: Saving data for TW15848: {'created_time': 1777276714.638914, 'last_price_update_time': 1777276714.638924, 'has_photos': True, 'auction_closing_time': 1777390209.0}
2026-04-27 07:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_59c716f556ed89fde53de914e830e5bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eb8a6d0>
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_b3d96d53d991a081693c8c79299d1eb3.jpg saved to cache
2026-04-27 07:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5a790>
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_59c716f556ed89fde53de914e830e5bc.jpg saved to cache
2026-04-27 07:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce
2026-04-27 07:58:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce, skipping ID generation
2026-04-27 07:58:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with scrape type 1
2026-04-27 07:58:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce sending to next pipeline
2026-04-27 07:58:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce, identifier: TS13333
2026-04-27 07:58:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-04-27 07:58:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-04-27 07:58:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333 to the API
2026-04-27 07:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_59c716f556ed89fde53de914e830e5bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:11:57Z',
 'fuel_type': 'diesel',
 'id': '29603b69-fccf-5ff6-8a0c-5dfdca1bacce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS13333',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Citroen',
 'model': 'C-Crosser',
 'odometer': 242683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_59c716f556ed89fde53de914e830e5bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_b3d96d53d991a081693c8c79299d1eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_4bc41ac64f8e88229bf2bf8c9ea89508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_bd9dc982c91d21082f76d8daafbb7720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_14d7565dca4dc0c3d5c86bd9d2d6bf0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_6973555003a39853edbe600a0e9a5d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_ac1070de61fde3c437b70038e167e94c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_17becc507992a1342f17c17431dfede6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_e38646514786c75bc043d43c8e3cb2ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_29603b69-fccf-5ff6-8a0c-5dfdca1bacce/29603b69-fccf-5ff6-8a0c-5dfdca1bacce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/65/f4654b986b2786f11b97d7f96f74c736/pa/TS13333_70a7ca5a08be71f8a01b14a039455d03.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2010-09-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-04-27 07:58:35 [auto1.de] INFO: Saving data for TS13333: {'created_time': 1777276715.216052, 'last_price_update_time': 1777276715.216063, 'has_photos': True, 'auction_closing_time': 1777389117.0}
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP87454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ83699> (referer: https://www.auto1.com/v1/car-details-view/ZZ83699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3bd671-854a-55e0-bd22-625abfce462a with identifier: ZZ83699
2026-04-27 07:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3bd671-854a-55e0-bd22-625abfce462a with scrape type 1
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_cca098bbd219694b9290cff96eeb5322.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_13ddff554f3abf48853dc113c74a2f54.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_4b0a9978395d7bfe654087ac6e41cb07.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_6dd11b02f7c4a96534b48b84f0da3111.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_7858c5ff848806a6dd933733728575f6.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_3ca9b412dd88a3882eed57f9c661b715.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_df0df9b0d6b78abd88f0979a62e2ba1b.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5bafca580f267182010e11aa788cc178.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5f1ef02bbba738bc94938f306ddaa8f5.jpg not downloaded yet
2026-04-27 07:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_f5a697c3ff49b41d0119f7aa96cac81a.jpg not downloaded yet
2026-04-27 07:58:43 [scrapy.extensions.logstats] INFO: Crawled 318 pages (at 16 pages/min), scraped 127 items (at 6 items/min)
2026-04-27 07:58:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK13927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_f5a697c3ff49b41d0119f7aa96cac81a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179dd0>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_f5a697c3ff49b41d0119f7aa96cac81a.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD98711> (referer: https://www.auto1.com/v1/car-details-view/PD98711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5f1ef02bbba738bc94938f306ddaa8f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d833c78a-689a-5ece-9e50-bcac27ad33ea with identifier: PD98711
2026-04-27 07:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d833c78a-689a-5ece-9e50-bcac27ad33ea with scrape type 1
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_859ada63c57a3df1b05af74bebd6f613.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_a38abd331537f62c054f8f1ed9f6b1ac.jpg not downloaded yet
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5bafca580f267182010e11aa788cc178.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_f22abddd40988700d540f21a6b1d785d.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_648309226975e44c162bc98fae964dc6.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_ecfed2da031e9e2ff42f4232ff1a7558.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_77a2dcf50fc44e339645bd11c52acfb1.jpg not downloaded yet
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd34d0>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5f1ef02bbba738bc94938f306ddaa8f5.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_c0fb74538dbb668fa64e4e103b3f4c40.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_7113c3ed0dcfcb8a2c6beadfcdff3a3b.jpg not downloaded yet
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_0612db97232f00ace0e24ee07bdb4402.jpg not downloaded yet
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05390>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5bafca580f267182010e11aa788cc178.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_b91e9d18ca3564e1fb2deaedabbb0d21.jpg not downloaded yet
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_a38abd331537f62c054f8f1ed9f6b1ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017a7d0>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_a38abd331537f62c054f8f1ed9f6b1ac.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_b91e9d18ca3564e1fb2deaedabbb0d21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85210>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_b91e9d18ca3564e1fb2deaedabbb0d21.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_0612db97232f00ace0e24ee07bdb4402.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a9190>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_0612db97232f00ace0e24ee07bdb4402.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK77340> (referer: https://www.auto1.com/v1/car-details-view/EK77340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK31693> (referer: https://www.auto1.com/v1/car-details-view/WK31693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_7113c3ed0dcfcb8a2c6beadfcdff3a3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with identifier: EK77340
2026-04-27 07:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with scrape type 1
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_badc9b37895a4e239402d74ff8733ce6.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_232ec40582a3c1f0d16b7fc52e0f4f2c.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_90def04a23c74acef963b1cc69cd13a1.jpg not downloaded yet
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_c0fb74538dbb668fa64e4e103b3f4c40.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-04-27 07:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 1
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_d84d2937e9bc5b2b3b485b89bb412d46.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_b11590da8276a6ccd8ecaff4fa9bd155.jpg not downloaded yet
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f33d0>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_7113c3ed0dcfcb8a2c6beadfcdff3a3b.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_a4bc141b0ea7da9155119c812ddfb202.jpg not downloaded yet
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_77a2dcf50fc44e339645bd11c52acfb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_232ec40582a3c1f0d16b7fc52e0f4f2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg not downloaded yet
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_ecfed2da031e9e2ff42f4232ff1a7558.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_dd496ceb72291be2a3917f0149c41666.jpg not downloaded yet
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fee850>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_c0fb74538dbb668fa64e4e103b3f4c40.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_f4acbf2fdd796d151b7a31343da2621e.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg not downloaded yet
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdb4d0>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_77a2dcf50fc44e339645bd11c52acfb1.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65510>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_232ec40582a3c1f0d16b7fc52e0f4f2c.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_227d1557d3fa2dba7fd88c60a1e5c085.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_2a566e7c7714d59d48ddad95a5c9f5fd.jpg not downloaded yet
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efba10>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_ecfed2da031e9e2ff42f4232ff1a7558.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_b11590da8276a6ccd8ecaff4fa9bd155.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_a4bc141b0ea7da9155119c812ddfb202.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg not downloaded yet
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg not downloaded yet
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg not downloaded yet
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_227d1557d3fa2dba7fd88c60a1e5c085.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a57390>
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_b11590da8276a6ccd8ecaff4fa9bd155.jpg saved to cache
2026-04-27 07:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030bf50>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_a4bc141b0ea7da9155119c812ddfb202.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e61b50>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f53810>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_227d1557d3fa2dba7fd88c60a1e5c085.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR08118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cfa790>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_2a566e7c7714d59d48ddad95a5c9f5fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c09d0>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f78d0>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc3690>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_2a566e7c7714d59d48ddad95a5c9f5fd.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_f4acbf2fdd796d151b7a31343da2621e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bf650>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4f7d0>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_dd496ceb72291be2a3917f0149c41666.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a410>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_f4acbf2fdd796d151b7a31343da2621e.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a63f10>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_d84d2937e9bc5b2b3b485b89bb412d46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK50134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cfb4d0>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_dd496ceb72291be2a3917f0149c41666.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9b690>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a58c10>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_d84d2937e9bc5b2b3b485b89bb412d46.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_badc9b37895a4e239402d74ff8733ce6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9a910>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_90def04a23c74acef963b1cc69cd13a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f37d0>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg saved to cache
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-04-27 07:58:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f47b5984-7d4f-554a-b492-9773e9944a4c, skipping ID generation
2026-04-27 07:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 1
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f47b5984-7d4f-554a-b492-9773e9944a4c sending to next pipeline
2026-04-27 07:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f47b5984-7d4f-554a-b492-9773e9944a4c, identifier: WK31693
2026-04-27 07:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-04-27 07:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-04-27 07:58:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693 to the API
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Schkopau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:35:14Z',
 'fuel_type': 'petrol',
 'id': 'f47b5984-7d4f-554a-b492-9773e9944a4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK31693',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 108785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2015}
2026-04-27 07:58:49 [auto1.de] INFO: Saving data for WK31693: {'created_time': 1777276729.968006, 'last_price_update_time': 1777276729.968016, 'has_photos': True, 'auction_closing_time': 1777390514.0}
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_648309226975e44c162bc98fae964dc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_859ada63c57a3df1b05af74bebd6f613.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_f22abddd40988700d540f21a6b1d785d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a60d50>
2026-04-27 07:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_badc9b37895a4e239402d74ff8733ce6.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f71050>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_90def04a23c74acef963b1cc69cd13a1.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217
2026-04-27 07:58:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a66b98e-f13a-56d2-b9f0-c5adceb18217, skipping ID generation
2026-04-27 07:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with scrape type 1
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a66b98e-f13a-56d2-b9f0-c5adceb18217 sending to next pipeline
2026-04-27 07:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a66b98e-f13a-56d2-b9f0-c5adceb18217, identifier: EK77340
2026-04-27 07:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with identifier: EK77340
2026-04-27 07:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with identifier: EK77340
2026-04-27 07:58:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a66b98e-f13a-56d2-b9f0-c5adceb18217 with identifier: EK77340 to the API
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_90def04a23c74acef963b1cc69cd13a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-04-28T15:37:56Z',
 'fuel_type': 'petrol',
 'id': '1a66b98e-f13a-56d2-b9f0-c5adceb18217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK77340',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 109298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_badc9b37895a4e239402d74ff8733ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_232ec40582a3c1f0d16b7fc52e0f4f2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_90def04a23c74acef963b1cc69cd13a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_d84d2937e9bc5b2b3b485b89bb412d46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_b11590da8276a6ccd8ecaff4fa9bd155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_a4bc141b0ea7da9155119c812ddfb202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_dd496ceb72291be2a3917f0149c41666.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_f4acbf2fdd796d151b7a31343da2621e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_227d1557d3fa2dba7fd88c60a1e5c085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1a66b98e-f13a-56d2-b9f0-c5adceb18217/1a66b98e-f13a-56d2-b9f0-c5adceb18217_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/1e/581edfab4a5a328bc2bb0dab314b8a1e/pa/EK77340_2a566e7c7714d59d48ddad95a5c9f5fd.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2014-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-04-27 07:58:50 [auto1.de] INFO: Saving data for EK77340: {'created_time': 1777276730.499943, 'last_price_update_time': 1777276730.499957, 'has_photos': True, 'auction_closing_time': 1777390676.0}
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c37a10>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_648309226975e44c162bc98fae964dc6.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c08ad0>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_859ada63c57a3df1b05af74bebd6f613.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cfad90>
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_f22abddd40988700d540f21a6b1d785d.jpg saved to cache
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d833c78a-689a-5ece-9e50-bcac27ad33ea
2026-04-27 07:58:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d833c78a-689a-5ece-9e50-bcac27ad33ea, skipping ID generation
2026-04-27 07:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d833c78a-689a-5ece-9e50-bcac27ad33ea with scrape type 1
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d833c78a-689a-5ece-9e50-bcac27ad33ea sending to next pipeline
2026-04-27 07:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d833c78a-689a-5ece-9e50-bcac27ad33ea, identifier: PD98711
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE77695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d833c78a-689a-5ece-9e50-bcac27ad33ea with identifier: PD98711
2026-04-27 07:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d833c78a-689a-5ece-9e50-bcac27ad33ea with identifier: PD98711
2026-04-27 07:58:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d833c78a-689a-5ece-9e50-bcac27ad33ea with identifier: PD98711 to the API
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_f22abddd40988700d540f21a6b1d785d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'city': 'Erbach',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:13:14Z',
 'fuel_type': 'diesel',
 'id': 'd833c78a-689a-5ece-9e50-bcac27ad33ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD98711',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 199855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_859ada63c57a3df1b05af74bebd6f613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_a38abd331537f62c054f8f1ed9f6b1ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_f22abddd40988700d540f21a6b1d785d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_648309226975e44c162bc98fae964dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_ecfed2da031e9e2ff42f4232ff1a7558.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_77a2dcf50fc44e339645bd11c52acfb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_c0fb74538dbb668fa64e4e103b3f4c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_7113c3ed0dcfcb8a2c6beadfcdff3a3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_0612db97232f00ace0e24ee07bdb4402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d833c78a-689a-5ece-9e50-bcac27ad33ea/d833c78a-689a-5ece-9e50-bcac27ad33ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/45/394543a8ac89d16c627bdf468111a422/pa/PD98711_b91e9d18ca3564e1fb2deaedabbb0d21.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2016-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Trailhawk 4WD',
 'transmission': 'automatic',
 'trim': 'Trailhawk 4WD',
 'year': 2016}
2026-04-27 07:58:51 [auto1.de] INFO: Saving data for PD98711: {'created_time': 1777276731.093603, 'last_price_update_time': 1777276731.093613, 'has_photos': True, 'auction_closing_time': 1777389194.0}
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_df0df9b0d6b78abd88f0979a62e2ba1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_7858c5ff848806a6dd933733728575f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_3ca9b412dd88a3882eed57f9c661b715.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML65322/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_cca098bbd219694b9290cff96eeb5322.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW12132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_13ddff554f3abf48853dc113c74a2f54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f470d0>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_df0df9b0d6b78abd88f0979a62e2ba1b.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3025a250>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_7858c5ff848806a6dd933733728575f6.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b789d0>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_3ca9b412dd88a3882eed57f9c661b715.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_6dd11b02f7c4a96534b48b84f0da3111.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_4b0a9978395d7bfe654087ac6e41cb07.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e63ad0>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_cca098bbd219694b9290cff96eeb5322.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dd150>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_13ddff554f3abf48853dc113c74a2f54.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1890>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_6dd11b02f7c4a96534b48b84f0da3111.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0ac10>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_4b0a9978395d7bfe654087ac6e41cb07.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f3bd671-854a-55e0-bd22-625abfce462a
2026-04-27 07:58:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f3bd671-854a-55e0-bd22-625abfce462a, skipping ID generation
2026-04-27 07:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3bd671-854a-55e0-bd22-625abfce462a with scrape type 1
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f3bd671-854a-55e0-bd22-625abfce462a sending to next pipeline
2026-04-27 07:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f3bd671-854a-55e0-bd22-625abfce462a, identifier: ZZ83699
2026-04-27 07:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f3bd671-854a-55e0-bd22-625abfce462a with identifier: ZZ83699
2026-04-27 07:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f3bd671-854a-55e0-bd22-625abfce462a with identifier: ZZ83699
2026-04-27 07:58:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f3bd671-854a-55e0-bd22-625abfce462a with identifier: ZZ83699 to the API
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_4b0a9978395d7bfe654087ac6e41cb07.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'city': 'Oberhausen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-04-28T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '4f3bd671-854a-55e0-bd22-625abfce462a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.7833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ83699',
 'listing': 'auction',
 'location': 'DE, Oberhausen',
 'location_confidence': 'geocoded',
 'longitude': 11.1333,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 99214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_cca098bbd219694b9290cff96eeb5322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_13ddff554f3abf48853dc113c74a2f54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_4b0a9978395d7bfe654087ac6e41cb07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_6dd11b02f7c4a96534b48b84f0da3111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_7858c5ff848806a6dd933733728575f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_3ca9b412dd88a3882eed57f9c661b715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_df0df9b0d6b78abd88f0979a62e2ba1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5bafca580f267182010e11aa788cc178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_5f1ef02bbba738bc94938f306ddaa8f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f3bd671-854a-55e0-bd22-625abfce462a/4f3bd671-854a-55e0-bd22-625abfce462a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2c63efbefd966e58ac29e24f0f875/pa/ZZ83699_f5a697c3ff49b41d0119f7aa96cac81a.jpg',
             'Width': 800}],
 'postal_code': '82386',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2020-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-04-27 07:58:51 [auto1.de] INFO: Saving data for ZZ83699: {'created_time': 1777276731.961963, 'last_price_update_time': 1777276731.961973, 'has_photos': True, 'auction_closing_time': 1777391457.0}
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN19474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP87454> (referer: https://www.auto1.com/v1/car-details-view/WP87454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 947a57fa-4350-54b1-a554-b6be97b50fa6 with identifier: WP87454
2026-04-27 07:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947a57fa-4350-54b1-a554-b6be97b50fa6 with scrape type 1
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_5652ad8cf8bfd15604075721682e6653.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_cc7c9b12c3e75aa55f5821b81c6f0c92.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT72839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_fb33066756e83b5e6c32be1b0b3d861f.jpg not downloaded yet
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_9faee1b542d86e5126342a81b9c5fc3a.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_56cf6d83f4f023b6ca3a2b5494f34108.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_0105009a01c4c852ec5f96e77b4cf0b1.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_073e0b856d707c95319a4d6a07c30112.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_a3c85dcd2775f5edd835c8a21b2dc28b.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_59561cf9cd6b1bad88d2e5df847b16c8.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_311adf133a721cfcfc19e22332e9df5e.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_cc7c9b12c3e75aa55f5821b81c6f0c92.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd0710>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_cc7c9b12c3e75aa55f5821b81c6f0c92.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK13927> (referer: https://www.auto1.com/v1/car-details-view/EK13927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR08118> (referer: https://www.auto1.com/v1/car-details-view/KR08118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-04-27 07:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb282563-d73a-54cf-bbf3-3184ba59ade6 with scrape type 1
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8787a05-4755-53f9-b35b-54fc388c8b12 with identifier: KR08118
2026-04-27 07:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8787a05-4755-53f9-b35b-54fc388c8b12 with scrape type 1
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9990ae60548db5563c703b5c4cc8943a.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_311adf133a721cfcfc19e22332e9df5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f6ded3f7b8d474e3bc9bcabdbccbffa6.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_59561cf9cd6b1bad88d2e5df847b16c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f33bb53512df7166bf3ee0dc731ab90e.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_3710f82d9ada725415de92609703a9f6.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV47209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e09690>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_311adf133a721cfcfc19e22332e9df5e.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f69190>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_59561cf9cd6b1bad88d2e5df847b16c8.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg not downloaded yet
2026-04-27 07:58:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9990ae60548db5563c703b5c4cc8943a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9554b963f179a781cd79228c274445df.jpg not downloaded yet
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_5e282eb6ea119ebad99108b679ab2921.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_e65e4fa225647754fe9390bb735cb1d3.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_6c9a52e28c18cdd633a8ff941ec2715b.jpg not downloaded yet
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_d8be32db45588d2be3540334d952f81d.jpg not downloaded yet
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3950>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9990ae60548db5563c703b5c4cc8943a.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_0dfa3a89122bf316d0c68080322abc86.jpg not downloaded yet
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9a0d0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_3710f82d9ada725415de92609703a9f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91a50>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30292bd0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_0dfa3a89122bf316d0c68080322abc86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b98110>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_3710f82d9ada725415de92609703a9f6.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_d8be32db45588d2be3540334d952f81d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3950>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_0dfa3a89122bf316d0c68080322abc86.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e934d0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_d8be32db45588d2be3540334d952f81d.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_6c9a52e28c18cdd633a8ff941ec2715b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY08054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS74193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65950>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_6c9a52e28c18cdd633a8ff941ec2715b.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9b990>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_e65e4fa225647754fe9390bb735cb1d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_5e282eb6ea119ebad99108b679ab2921.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE77695> (referer: https://www.auto1.com/v1/car-details-view/FE77695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c37b90>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_e65e4fa225647754fe9390bb735cb1d3.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ae3d0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_5e282eb6ea119ebad99108b679ab2921.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f33bb53512df7166bf3ee0dc731ab90e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS10093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e76290>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce2750>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9554b963f179a781cd79228c274445df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f0eb56-3809-5400-9911-5b3c830baa0f with identifier: FE77695
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f0eb56-3809-5400-9911-5b3c830baa0f with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_b7adc0ac54b5aba4937d3f19ae144b63.jpg not downloaded yet
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_1daca0f73a6e6f3a12d817a14d587a68.jpg not downloaded yet
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b041d0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f33bb53512df7166bf3ee0dc731ab90e.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_e33ff27500496aae45ed4ea2ce08416f.jpg not downloaded yet
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_bab6687ddcffa0430e59b1b2c51d5e88.jpg not downloaded yet
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_4ed4af94984ea96926079fddc3b8cce8.jpg not downloaded yet
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e60e50>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9554b963f179a781cd79228c274445df.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f6ded3f7b8d474e3bc9bcabdbccbffa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30259fd0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017d390>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c35490>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f6ded3f7b8d474e3bc9bcabdbccbffa6.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8787a05-4755-53f9-b35b-54fc388c8b12
2026-04-27 07:58:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8787a05-4755-53f9-b35b-54fc388c8b12, skipping ID generation
2026-04-27 07:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8787a05-4755-53f9-b35b-54fc388c8b12 with scrape type 1
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8787a05-4755-53f9-b35b-54fc388c8b12 sending to next pipeline
2026-04-27 07:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8787a05-4755-53f9-b35b-54fc388c8b12, identifier: KR08118
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8787a05-4755-53f9-b35b-54fc388c8b12 with identifier: KR08118
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8787a05-4755-53f9-b35b-54fc388c8b12 with identifier: KR08118
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8787a05-4755-53f9-b35b-54fc388c8b12 with identifier: KR08118 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f6ded3f7b8d474e3bc9bcabdbccbffa6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'city': 'Kerpen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:51:19Z',
 'fuel_type': 'petrol',
 'id': 'b8787a05-4755-53f9-b35b-54fc388c8b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR08118',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 71379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9990ae60548db5563c703b5c4cc8943a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f6ded3f7b8d474e3bc9bcabdbccbffa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_f33bb53512df7166bf3ee0dc731ab90e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_3710f82d9ada725415de92609703a9f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_9554b963f179a781cd79228c274445df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_5e282eb6ea119ebad99108b679ab2921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_e65e4fa225647754fe9390bb735cb1d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_6c9a52e28c18cdd633a8ff941ec2715b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_d8be32db45588d2be3540334d952f81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8787a05-4755-53f9-b35b-54fc388c8b12/b8787a05-4755-53f9-b35b-54fc388c8b12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/96/8496e48eb5510f84465fb8abce595acb/pa/KR08118_0dfa3a89122bf316d0c68080322abc86.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-04-27 07:58:55 [auto1.de] INFO: Saving data for KR08118: {'created_time': 1777276735.846205, 'last_price_update_time': 1777276735.846215, 'has_photos': True, 'auction_closing_time': 1777391479.0}
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_4ed4af94984ea96926079fddc3b8cce8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_bab6687ddcffa0430e59b1b2c51d5e88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_e33ff27500496aae45ed4ea2ce08416f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN19474> (referer: https://www.auto1.com/v1/car-details-view/FN19474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF85631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW12132> (referer: https://www.auto1.com/v1/car-details-view/PW12132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML65322> (referer: https://www.auto1.com/v1/car-details-view/ML65322/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd03d0>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg saved to cache
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bf3d0>
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_4ed4af94984ea96926079fddc3b8cce8.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee8710>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_bab6687ddcffa0430e59b1b2c51d5e88.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_b7adc0ac54b5aba4937d3f19ae144b63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6b310>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_e33ff27500496aae45ed4ea2ce08416f.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a99c20-4c73-560c-9e7e-fa28eed28f7c with identifier: FN19474
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_2429781762d0dc2f4bf192ffc0829dcd.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d7ad3fdc7e2e11d92172a6df5737b0c5.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with identifier: ML65322
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d9298dfdbe68662a284a62f9dd4d885e.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3259154db2db89b284e7b07ce4480295.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_cb2a3208e8d3c16677296c64b8e2acb7.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_7cc93fa9080533b3dfff6a00260c208a.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_a3c85dcd2775f5edd835c8a21b2dc28b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_1daca0f73a6e6f3a12d817a14d587a68.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fec0d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_b7adc0ac54b5aba4937d3f19ae144b63.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a1f10>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb282563-d73a-54cf-bbf3-3184ba59ade6, skipping ID generation
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb282563-d73a-54cf-bbf3-3184ba59ade6 with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb282563-d73a-54cf-bbf3-3184ba59ade6 sending to next pipeline
2026-04-27 07:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb282563-d73a-54cf-bbf3-3184ba59ade6, identifier: EK13927
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_700db101717de05fd42074e44a4850ae.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_09e20c7dfd9e5ab30f5845b7f8a5daaa.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_4910b3ac4e566e285388c0994d789fbe.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-04-27 07:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-04-27 07:58:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927 to the API
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Schkopau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:09:06Z',
 'fuel_type': 'petrol',
 'id': 'bb282563-d73a-54cf-bbf3-3184ba59ade6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK13927',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 267645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-04-27 07:58:56 [auto1.de] INFO: Saving data for EK13927: {'created_time': 1777276736.816985, 'last_price_update_time': 1777276736.816995, 'has_photos': True, 'auction_closing_time': 1777388946.0}
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_073e0b856d707c95319a4d6a07c30112.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_9faee1b542d86e5126342a81b9c5fc3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_56cf6d83f4f023b6ca3a2b5494f34108.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_0105009a01c4c852ec5f96e77b4cf0b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_fb33066756e83b5e6c32be1b0b3d861f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3bb3232e782efc5f2f998d6accc93b30.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_f0f603a902dd21c3255621aa72ce453f.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_620cc8002d57ae4ea55ad5729c652b27.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30165750>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_a3c85dcd2775f5edd835c8a21b2dc28b.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0ca10>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_1daca0f73a6e6f3a12d817a14d587a68.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97f0eb56-3809-5400-9911-5b3c830baa0f
2026-04-27 07:58:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97f0eb56-3809-5400-9911-5b3c830baa0f, skipping ID generation
2026-04-27 07:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f0eb56-3809-5400-9911-5b3c830baa0f with scrape type 1
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97f0eb56-3809-5400-9911-5b3c830baa0f sending to next pipeline
2026-04-27 07:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97f0eb56-3809-5400-9911-5b3c830baa0f, identifier: FE77695
2026-04-27 07:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97f0eb56-3809-5400-9911-5b3c830baa0f with identifier: FE77695
2026-04-27 07:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97f0eb56-3809-5400-9911-5b3c830baa0f with identifier: FE77695
2026-04-27 07:58:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97f0eb56-3809-5400-9911-5b3c830baa0f with identifier: FE77695 to the API
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_1daca0f73a6e6f3a12d817a14d587a68.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'city': 'Kippenheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:06:33Z',
 'fuel_type': 'petrol',
 'id': '97f0eb56-3809-5400-9911-5b3c830baa0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE77695',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 231541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_b7adc0ac54b5aba4937d3f19ae144b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_1daca0f73a6e6f3a12d817a14d587a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_e33ff27500496aae45ed4ea2ce08416f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_bab6687ddcffa0430e59b1b2c51d5e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97f0eb56-3809-5400-9911-5b3c830baa0f/97f0eb56-3809-5400-9911-5b3c830baa0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e3/7be37943393c88b393d92f15f771814a/pa/FE77695_4ed4af94984ea96926079fddc3b8cce8.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2008-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-04-27 07:58:57 [auto1.de] INFO: Saving data for FE77695: {'created_time': 1777276737.468042, 'last_price_update_time': 1777276737.468053, 'has_photos': True, 'auction_closing_time': 1777388793.0}
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_58c475c002b125c3c29576080151df90.jpg not downloaded yet
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_66874597b084529a852bc3bbda7609a5.jpg not downloaded yet
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d0fd9034d3472d563746173a1fd6fda0.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_cb2a3208e8d3c16677296c64b8e2acb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d9298dfdbe68662a284a62f9dd4d885e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d7ad3fdc7e2e11d92172a6df5737b0c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c03ad0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_073e0b856d707c95319a4d6a07c30112.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff80d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_9faee1b542d86e5126342a81b9c5fc3a.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc85d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_56cf6d83f4f023b6ca3a2b5494f34108.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b72590>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_0105009a01c4c852ec5f96e77b4cf0b1.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc95d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_fb33066756e83b5e6c32be1b0b3d861f.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_7cc93fa9080533b3dfff6a00260c208a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_480cbfaada06057e7d323fad9dc94b1c.jpg not downloaded yet
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_eb168aeffcaa4fd53f168d26cd5e5799.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_4910b3ac4e566e285388c0994d789fbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_700db101717de05fd42074e44a4850ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_09e20c7dfd9e5ab30f5845b7f8a5daaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d9d559059de7e8e578be293191428a49.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS74193> (referer: https://www.auto1.com/v1/car-details-view/PS74193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff8d10>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_cb2a3208e8d3c16677296c64b8e2acb7.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a57f50>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d9298dfdbe68662a284a62f9dd4d885e.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005a3d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d7ad3fdc7e2e11d92172a6df5737b0c5.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_620cc8002d57ae4ea55ad5729c652b27.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_c72005cbef4553a3ad0d1f65cec3b469.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3bb3232e782efc5f2f998d6accc93b30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV47209> (referer: https://www.auto1.com/v1/car-details-view/RV47209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300420d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_7cc93fa9080533b3dfff6a00260c208a.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30287e90>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_4910b3ac4e566e285388c0994d789fbe.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9a790>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_700db101717de05fd42074e44a4850ae.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c211d0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_09e20c7dfd9e5ab30f5845b7f8a5daaa.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_cc212b1e8e5b657ae7da4acb11771738.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_f0f603a902dd21c3255621aa72ce453f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_1942e0cd91038735c7ea3c4670491657.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT72839> (referer: https://www.auto1.com/v1/car-details-view/HT72839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_66874597b084529a852bc3bbda7609a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d0fd9034d3472d563746173a1fd6fda0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_800733a4eeee1d79bd69627afd14f09b.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_480cbfaada06057e7d323fad9dc94b1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_eb168aeffcaa4fd53f168d26cd5e5799.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_a063c235724ba1b0337742dfa5a07021.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK50134> (referer: https://www.auto1.com/v1/car-details-view/WK50134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0c310>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_620cc8002d57ae4ea55ad5729c652b27.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea2150>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3bb3232e782efc5f2f998d6accc93b30.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a5ef8f-4576-53c4-83d8-15059c3afb5c with identifier: RV47209
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_837ea9ab51ca14704b9eaa39894b0606.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4bf19cfea49ce8346470ff5997addd07.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_e9cf6686c186306860e9f9c031f08bcf.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3259154db2db89b284e7b07ce4480295.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_9368105d0cb407bbcf1f3a54df91b3a7.jpg not downloaded yet
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3e10>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_f0f603a902dd21c3255621aa72ce453f.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg not downloaded yet
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee0550>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_66874597b084529a852bc3bbda7609a5.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f47410>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d0fd9034d3472d563746173a1fd6fda0.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3, skipping ID generation
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 sending to next pipeline
2026-04-27 07:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3, identifier: ML65322
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82a50>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_480cbfaada06057e7d323fad9dc94b1c.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dca210>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_eb168aeffcaa4fd53f168d26cd5e5799.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_cc212b1e8e5b657ae7da4acb11771738.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_c72005cbef4553a3ad0d1f65cec3b469.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d9d559059de7e8e578be293191428a49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_91655bdfe7800535f3cac756e421361e.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with identifier: ML65322
2026-04-27 07:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with identifier: ML65322
2026-04-27 07:58:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce73d300-a38f-5e2f-a4d1-7b22eec22cb3 with identifier: ML65322 to the API
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d0fd9034d3472d563746173a1fd6fda0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'city': 'Kerpen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-04-28T15:31:01Z',
 'fuel_type': 'petrol',
 'id': 'ce73d300-a38f-5e2f-a4d1-7b22eec22cb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML65322',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 185566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d9298dfdbe68662a284a62f9dd4d885e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_7cc93fa9080533b3dfff6a00260c208a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_4910b3ac4e566e285388c0994d789fbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_620cc8002d57ae4ea55ad5729c652b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce73d300-a38f-5e2f-a4d1-7b22eec22cb3/ce73d300-a38f-5e2f-a4d1-7b22eec22cb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/c5/e0c5699d07735592e9e8a5860482f405/pa/ML65322_d0fd9034d3472d563746173a1fd6fda0.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2007-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-04-27 07:58:59 [auto1.de] INFO: Saving data for ML65322: {'created_time': 1777276739.448576, 'last_price_update_time': 1777276739.448591, 'has_photos': True, 'auction_closing_time': 1777390261.0}
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_2429781762d0dc2f4bf192ffc0829dcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_5652ad8cf8bfd15604075721682e6653.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_1942e0cd91038735c7ea3c4670491657.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_8bbfaac868f8e2c04c24ac014f5e2925.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg not downloaded yet
2026-04-27 07:58:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-04-27 07:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with scrape type 1
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bb9c83fff4cdb83ff092ee84ac3e9be1.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_800733a4eeee1d79bd69627afd14f09b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_2b36dca36028d534e569a575118c1def.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c02090>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3259154db2db89b284e7b07ce4480295.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4cb32e1e5c3994589ddcf9ac96750dc5.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_8f35a950be661ecbaf7662792167f44a.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY08054> (referer: https://www.auto1.com/v1/car-details-view/VY08054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a70850>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_cc212b1e8e5b657ae7da4acb11771738.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f84350>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_c72005cbef4553a3ad0d1f65cec3b469.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302809d0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d9d559059de7e8e578be293191428a49.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_57b0e5fd283f9e983e30940e931b5ca2.jpg not downloaded yet
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_9368105d0cb407bbcf1f3a54df91b3a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_837ea9ab51ca14704b9eaa39894b0606.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_e9cf6686c186306860e9f9c031f08bcf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4bf19cfea49ce8346470ff5997addd07.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_ae32de73f8b76f35c886e205e8afd8ff.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_b0345828c59cc6c08e43a6cf793dbee7.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005bc10>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_2429781762d0dc2f4bf192ffc0829dcd.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30061a90>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_5652ad8cf8bfd15604075721682e6653.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 947a57fa-4350-54b1-a554-b6be97b50fa6
2026-04-27 07:58:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 947a57fa-4350-54b1-a554-b6be97b50fa6, skipping ID generation
2026-04-27 07:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947a57fa-4350-54b1-a554-b6be97b50fa6 with scrape type 1
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 947a57fa-4350-54b1-a554-b6be97b50fa6 sending to next pipeline
2026-04-27 07:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 947a57fa-4350-54b1-a554-b6be97b50fa6, identifier: WP87454
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f59d50>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_1942e0cd91038735c7ea3c4670491657.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_58c475c002b125c3c29576080151df90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_a063c235724ba1b0337742dfa5a07021.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_66dd18006b9788abd9942d171084a17c.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 947a57fa-4350-54b1-a554-b6be97b50fa6 with identifier: WP87454
2026-04-27 07:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 947a57fa-4350-54b1-a554-b6be97b50fa6 with identifier: WP87454
2026-04-27 07:59:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 947a57fa-4350-54b1-a554-b6be97b50fa6 with identifier: WP87454 to the API
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_5652ad8cf8bfd15604075721682e6653.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:09:17Z',
 'fuel_type': 'petrol',
 'id': '947a57fa-4350-54b1-a554-b6be97b50fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP87454',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 141686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_5652ad8cf8bfd15604075721682e6653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_cc7c9b12c3e75aa55f5821b81c6f0c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_fb33066756e83b5e6c32be1b0b3d861f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_9faee1b542d86e5126342a81b9c5fc3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_56cf6d83f4f023b6ca3a2b5494f34108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_0105009a01c4c852ec5f96e77b4cf0b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_073e0b856d707c95319a4d6a07c30112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_a3c85dcd2775f5edd835c8a21b2dc28b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_59561cf9cd6b1bad88d2e5df847b16c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_947a57fa-4350-54b1-a554-b6be97b50fa6/947a57fa-4350-54b1-a554-b6be97b50fa6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/d0/15d0e6b5c6ae72a0ea03f405bfd4ce79/pa/WP87454_311adf133a721cfcfc19e22332e9df5e.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2016-10-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-04-27 07:59:00 [auto1.de] INFO: Saving data for WP87454: {'created_time': 1777276740.488055, 'last_price_update_time': 1777276740.488065, 'has_photos': True, 'auction_closing_time': 1777388957.0}
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd4750>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_800733a4eeee1d79bd69627afd14f09b.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-04-27 07:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b3e7d5-3abe-5d35-b76e-575ad020762d with scrape type 1
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_3730df5263a9338386af125fd2a5fcef.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_6286c179dd1231c614084c0dabf4d5d3.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bf3d79a415faac5f5258355f4e77deb2.jpg not downloaded yet
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_2b36dca36028d534e569a575118c1def.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_91655bdfe7800535f3cac756e421361e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_c76780ea813b4608d43ee1d895caedf2.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_568f468aad0d8cf2f98cae0cbcc3c85d.jpg not downloaded yet
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b58d0>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_9368105d0cb407bbcf1f3a54df91b3a7.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9cf10>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_837ea9ab51ca14704b9eaa39894b0606.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b4690>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_e9cf6686c186306860e9f9c031f08bcf.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e23050>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4bf19cfea49ce8346470ff5997addd07.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_a6ce00a741c12eaa6bf81546d87f8cba.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_380e5fe4903b2efab4e46fe5a4ac5e58.jpg not downloaded yet
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF85631> (referer: https://www.auto1.com/v1/car-details-view/PF85631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB76196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS10093> (referer: https://www.auto1.com/v1/car-details-view/LS10093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d450>
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_58c475c002b125c3c29576080151df90.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c
2026-04-27 07:59:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23a99c20-4c73-560c-9e7e-fa28eed28f7c, skipping ID generation
2026-04-27 07:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c with scrape type 1
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23a99c20-4c73-560c-9e7e-fa28eed28f7c sending to next pipeline
2026-04-27 07:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23a99c20-4c73-560c-9e7e-fa28eed28f7c, identifier: FN19474
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d61610>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9ea50>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_a063c235724ba1b0337742dfa5a07021.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e801c8b0-4bce-5ff9-90dd-820987634a68
2026-04-27 07:59:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e801c8b0-4bce-5ff9-90dd-820987634a68, skipping ID generation
2026-04-27 07:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 1
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e801c8b0-4bce-5ff9-90dd-820987634a68 sending to next pipeline
2026-04-27 07:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e801c8b0-4bce-5ff9-90dd-820987634a68, identifier: PW12132
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bb9c83fff4cdb83ff092ee84ac3e9be1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_8f35a950be661ecbaf7662792167f44a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_ecc0e59436728a8f84baff59c9ceadb8.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_b9f1c7e5f51f779fdf29326c8b33859e.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23a99c20-4c73-560c-9e7e-fa28eed28f7c with identifier: FN19474
2026-04-27 07:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23a99c20-4c73-560c-9e7e-fa28eed28f7c with identifier: FN19474
2026-04-27 07:59:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23a99c20-4c73-560c-9e7e-fa28eed28f7c with identifier: FN19474 to the API
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_58c475c002b125c3c29576080151df90.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'Schkopau',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:58:51Z',
 'fuel_type': 'diesel',
 'id': '23a99c20-4c73-560c-9e7e-fa28eed28f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN19474',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 212171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_2429781762d0dc2f4bf192ffc0829dcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3259154db2db89b284e7b07ce4480295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_700db101717de05fd42074e44a4850ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_3bb3232e782efc5f2f998d6accc93b30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_58c475c002b125c3c29576080151df90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23a99c20-4c73-560c-9e7e-fa28eed28f7c/23a99c20-4c73-560c-9e7e-fa28eed28f7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/e7/f4e748c5905708a13c8dcff96eb24559/pa/FN19474_480cbfaada06057e7d323fad9dc94b1c.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-04-27 07:59:01 [auto1.de] INFO: Saving data for FN19474: {'created_time': 1777276741.768138, 'last_price_update_time': 1777276741.768148, 'has_photos': True, 'auction_closing_time': 1777391931.0}
2026-04-27 07:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-04-27 07:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-04-27 07:59:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132 to the API
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_a063c235724ba1b0337742dfa5a07021.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'city': 'Erbach',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-04-28T15:31:48Z',
 'fuel_type': 'diesel',
 'id': 'e801c8b0-4bce-5ff9-90dd-820987634a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW12132',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 97495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d7ad3fdc7e2e11d92172a6df5737b0c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_cb2a3208e8d3c16677296c64b8e2acb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_09e20c7dfd9e5ab30f5845b7f8a5daaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_f0f603a902dd21c3255621aa72ce453f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_66874597b084529a852bc3bbda7609a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_eb168aeffcaa4fd53f168d26cd5e5799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_d9d559059de7e8e578be293191428a49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_c72005cbef4553a3ad0d1f65cec3b469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_1942e0cd91038735c7ea3c4670491657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e801c8b0-4bce-5ff9-90dd-820987634a68/e801c8b0-4bce-5ff9-90dd-820987634a68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/95/ff950813e6aa4ccf434eb7ef512ba657/pa/PW12132_a063c235724ba1b0337742dfa5a07021.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2019-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-04-27 07:59:02 [auto1.de] INFO: Saving data for PW12132: {'created_time': 1777276742.301457, 'last_price_update_time': 1777276742.301469, 'has_photos': True, 'auction_closing_time': 1777390308.0}
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_8bbfaac868f8e2c04c24ac014f5e2925.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4cb32e1e5c3994589ddcf9ac96750dc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_57b0e5fd283f9e983e30940e931b5ca2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_03586693fbe4cd20d1c54658472afe9d.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_a5a174ff3a58a80134975f13d302cf1f.jpg not downloaded yet
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30281650>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_2b36dca36028d534e569a575118c1def.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3d410>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_91655bdfe7800535f3cac756e421361e.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_83e064c7a7f4c35d5052b973af656a72.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_da95bc19ac15c69f2163bfcffabb3b98.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with identifier: PF85631
2026-04-27 07:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with scrape type 1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e614dc5144b0eeb6a4ce20035216d0a5.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with identifier: LS10093
2026-04-27 07:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with scrape type 1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_dc0a28255e4fd2222dedc3753c6507a4.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_3730df5263a9338386af125fd2a5fcef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_66dd18006b9788abd9942d171084a17c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_9d0d4b36317d8f552159be265e184404.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e639b1e67a163a074e31cb8191df08f1.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_3f6077e5156e87bfcb477050ff821147.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_117355c940a91f570a629d2d5cc67366.jpg not downloaded yet
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f37010>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bb9c83fff4cdb83ff092ee84ac3e9be1.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bbfc90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_8f35a950be661ecbaf7662792167f44a.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa5390>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b7990>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_8bbfaac868f8e2c04c24ac014f5e2925.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0da50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4cb32e1e5c3994589ddcf9ac96750dc5.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5ed0>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_57b0e5fd283f9e983e30940e931b5ca2.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60d90>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_6286c179dd1231c614084c0dabf4d5d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg not downloaded yet
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_c76780ea813b4608d43ee1d895caedf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_8e496a0c8c64c427f9fef9e03f7b13a9.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e4c0ed16eff08edfb41354c4b2aad79d.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_50058b9a90531b4e650e79fd1ec029c5.jpg not downloaded yet
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_568f468aad0d8cf2f98cae0cbcc3c85d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bf3d79a415faac5f5258355f4e77deb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_b0345828c59cc6c08e43a6cf793dbee7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30074fd0>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_3730df5263a9338386af125fd2a5fcef.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff2710>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_66dd18006b9788abd9942d171084a17c.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_a6ce00a741c12eaa6bf81546d87f8cba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_084f98dbce023543fd8cd2cab1cd6d20.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_79cda19292e695f35909dda101a32799.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_e333e217d41f5b53eca9220271f027bd.jpg not downloaded yet
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_380e5fe4903b2efab4e46fe5a4ac5e58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026e7d0>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_6286c179dd1231c614084c0dabf4d5d3.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d92890>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_dc0a28255e4fd2222dedc3753c6507a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_48d155b195f88efe4b846369fdd2ba38.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_56a72747e0aeafe54ed3ac6cd29a5e7a.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_408e4df2b8dcbff0275b366ca1d96774.jpg not downloaded yet
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU34355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e614dc5144b0eeb6a4ce20035216d0a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_117355c940a91f570a629d2d5cc67366.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_18cd9254529b63a39a937ffed3f5a139.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_69280f4231aab7d5a646868ba09a0e90.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f47e7d1ad3f5800514790443308a864a.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c87410>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_c76780ea813b4608d43ee1d895caedf2.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302990d0>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_568f468aad0d8cf2f98cae0cbcc3c85d.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003b010>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bf3d79a415faac5f5258355f4e77deb2.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bea810>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_b0345828c59cc6c08e43a6cf793dbee7.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30038210>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_a6ce00a741c12eaa6bf81546d87f8cba.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e639b1e67a163a074e31cb8191df08f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_50058b9a90531b4e650e79fd1ec029c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e1196b5d32cea302d60dc831fa91570e.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_bef0a6ce6bf9c7c6a39a3160b6afdbe7.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_7fedb9f0c67030f2f7be6f85c2704601.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a22090>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_380e5fe4903b2efab4e46fe5a4ac5e58.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_3f6077e5156e87bfcb477050ff821147.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291f310>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_dc0a28255e4fd2222dedc3753c6507a4.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b60590>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a78a90>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01b90>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e614dc5144b0eeb6a4ce20035216d0a5.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b60d90>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a79d90>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_117355c940a91f570a629d2d5cc67366.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_f7498c8d250732d2ff4efd43b193201a.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_4fddab62b3e880e4169d348f52d3f7e1.jpg not downloaded yet
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_e333e217d41f5b53eca9220271f027bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_408e4df2b8dcbff0275b366ca1d96774.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_084f98dbce023543fd8cd2cab1cd6d20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_79cda19292e695f35909dda101a32799.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_56a72747e0aeafe54ed3ac6cd29a5e7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_a3266a42833035d70119fdef0060ed94.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f9724c99442183cfd5b20a510fc43796.jpg not downloaded yet
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f862d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e639b1e67a163a074e31cb8191df08f1.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee89d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_50058b9a90531b4e650e79fd1ec029c5.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad150>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30094890>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_3f6077e5156e87bfcb477050ff821147.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5af10>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_48d155b195f88efe4b846369fdd2ba38.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f47e7d1ad3f5800514790443308a864a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_7b46c6defd83c03361b0576c525c44c0.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_173ff8cb6b80b82190b8b703b8371487.jpg not downloaded yet
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e4c0ed16eff08edfb41354c4b2aad79d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_69280f4231aab7d5a646868ba09a0e90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_18cd9254529b63a39a937ffed3f5a139.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c1a090>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_e333e217d41f5b53eca9220271f027bd.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ac710>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_408e4df2b8dcbff0275b366ca1d96774.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b7d90>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_084f98dbce023543fd8cd2cab1cd6d20.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5b5d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_79cda19292e695f35909dda101a32799.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9b290>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_56a72747e0aeafe54ed3ac6cd29a5e7a.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_9d0d4b36317d8f552159be265e184404.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_7fedb9f0c67030f2f7be6f85c2704601.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_8e496a0c8c64c427f9fef9e03f7b13a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_4fddab62b3e880e4169d348f52d3f7e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05390>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_48d155b195f88efe4b846369fdd2ba38.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed2d10>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f47e7d1ad3f5800514790443308a864a.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b10790>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e4c0ed16eff08edfb41354c4b2aad79d.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30078f10>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_69280f4231aab7d5a646868ba09a0e90.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb4fd0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_18cd9254529b63a39a937ffed3f5a139.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_f7498c8d250732d2ff4efd43b193201a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f9724c99442183cfd5b20a510fc43796.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_da95bc19ac15c69f2163bfcffabb3b98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_83e064c7a7f4c35d5052b973af656a72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_a3266a42833035d70119fdef0060ed94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_bef0a6ce6bf9c7c6a39a3160b6afdbe7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_173ff8cb6b80b82190b8b703b8371487.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e1196b5d32cea302d60dc831fa91570e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0710>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_9d0d4b36317d8f552159be265e184404.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91d50>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_7fedb9f0c67030f2f7be6f85c2704601.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffb090>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_8e496a0c8c64c427f9fef9e03f7b13a9.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91d50>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_4fddab62b3e880e4169d348f52d3f7e1.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_a5a174ff3a58a80134975f13d302cf1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6b650>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_f7498c8d250732d2ff4efd43b193201a.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d910>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f9724c99442183cfd5b20a510fc43796.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1310>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_da95bc19ac15c69f2163bfcffabb3b98.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9f0d0>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_83e064c7a7f4c35d5052b973af656a72.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85590>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_a3266a42833035d70119fdef0060ed94.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ff50>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_bef0a6ce6bf9c7c6a39a3160b6afdbe7.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1a10>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_173ff8cb6b80b82190b8b703b8371487.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1
2026-04-27 07:59:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0ff615-88a5-5345-81f2-eb497a68b5d1, skipping ID generation
2026-04-27 07:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with scrape type 1
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b0ff615-88a5-5345-81f2-eb497a68b5d1 sending to next pipeline
2026-04-27 07:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0ff615-88a5-5345-81f2-eb497a68b5d1, identifier: LS10093
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028f990>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e1196b5d32cea302d60dc831fa91570e.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with identifier: LS10093
2026-04-27 07:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with identifier: LS10093
2026-04-27 07:59:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0ff615-88a5-5345-81f2-eb497a68b5d1 with identifier: LS10093 to the API
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_173ff8cb6b80b82190b8b703b8371487.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'city': 'Atting',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-04-28T15:50:53Z',
 'fuel_type': 'petrol',
 'id': '3b0ff615-88a5-5345-81f2-eb497a68b5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS10093',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 6981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_dc0a28255e4fd2222dedc3753c6507a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_117355c940a91f570a629d2d5cc67366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_50058b9a90531b4e650e79fd1ec029c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_e333e217d41f5b53eca9220271f027bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_408e4df2b8dcbff0275b366ca1d96774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f47e7d1ad3f5800514790443308a864a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_7fedb9f0c67030f2f7be6f85c2704601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_4fddab62b3e880e4169d348f52d3f7e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_f9724c99442183cfd5b20a510fc43796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b0ff615-88a5-5345-81f2-eb497a68b5d1/3b0ff615-88a5-5345-81f2-eb497a68b5d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/fa/91fafa4477acf857a759eaf63a859792/pa/LS10093_173ff8cb6b80b82190b8b703b8371487.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2023-12-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2023}
2026-04-27 07:59:06 [auto1.de] INFO: Saving data for LS10093: {'created_time': 1777276746.463307, 'last_price_update_time': 1777276746.463317, 'has_photos': True, 'auction_closing_time': 1777391453.0}
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_ae32de73f8b76f35c886e205e8afd8ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_7b46c6defd83c03361b0576c525c44c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_ecc0e59436728a8f84baff59c9ceadb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_03586693fbe4cd20d1c54658472afe9d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_b9f1c7e5f51f779fdf29326c8b33859e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB76196> (referer: https://www.auto1.com/v1/car-details-view/PB76196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU34355> (referer: https://www.auto1.com/v1/car-details-view/KU34355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8850>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-04-27 07:59:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7, skipping ID generation
2026-04-27 07:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with scrape type 1
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 sending to next pipeline
2026-04-27 07:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7, identifier: HT72839
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8390>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_a5a174ff3a58a80134975f13d302cf1f.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878
2026-04-27 07:59:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bd9b01f-5878-5c9c-9067-39da8cdd3878, skipping ID generation
2026-04-27 07:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with scrape type 1
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878 sending to next pipeline
2026-04-27 07:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bd9b01f-5878-5c9c-9067-39da8cdd3878, identifier: WK50134
2026-04-27 07:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-04-27 07:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-04-27 07:59:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839 to the API
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:19:04Z',
 'fuel_type': 'petrol',
 'id': 'f3413be3-2c20-5cc8-8f27-30a1e7aa94d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT72839',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 100902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2018}
2026-04-27 07:59:07 [auto1.de] INFO: Saving data for HT72839: {'created_time': 1777276747.219562, 'last_price_update_time': 1777276747.219596, 'has_photos': True, 'auction_closing_time': 1777389544.0}
2026-04-27 07:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-04-27 07:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-04-27 07:59:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134 to the API
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_a5a174ff3a58a80134975f13d302cf1f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:08:49Z',
 'fuel_type': 'diesel',
 'id': '2bd9b01f-5878-5c9c-9067-39da8cdd3878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK50134',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 369863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bb9c83fff4cdb83ff092ee84ac3e9be1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_8f35a950be661ecbaf7662792167f44a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_b0345828c59cc6c08e43a6cf793dbee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_bf3d79a415faac5f5258355f4e77deb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_380e5fe4903b2efab4e46fe5a4ac5e58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bd9b01f-5878-5c9c-9067-39da8cdd3878/2bd9b01f-5878-5c9c-9067-39da8cdd3878_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/cb/10cb9a39e4401f2de62f161376017c7d/pa/WK50134_a5a174ff3a58a80134975f13d302cf1f.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-04-27 07:59:07 [auto1.de] INFO: Saving data for WK50134: {'created_time': 1777276747.516331, 'last_price_update_time': 1777276747.516344, 'has_photos': True, 'auction_closing_time': 1777388929.0}
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV27190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH77652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdf910>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_ae32de73f8b76f35c886e205e8afd8ff.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34050>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_7b46c6defd83c03361b0576c525c44c0.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4
2026-04-27 07:59:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4, skipping ID generation
2026-04-27 07:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with scrape type 1
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 sending to next pipeline
2026-04-27 07:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4, identifier: PF85631
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdb010>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_ecc0e59436728a8f84baff59c9ceadb8.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68a5ef8f-4576-53c4-83d8-15059c3afb5c, skipping ID generation
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68a5ef8f-4576-53c4-83d8-15059c3afb5c sending to next pipeline
2026-04-27 07:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68a5ef8f-4576-53c4-83d8-15059c3afb5c, identifier: RV47209
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ad89d0>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_03586693fbe4cd20d1c54658472afe9d.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c911216f-2756-541d-8dfc-2e18f22bded4
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c911216f-2756-541d-8dfc-2e18f22bded4, skipping ID generation
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c911216f-2756-541d-8dfc-2e18f22bded4 sending to next pipeline
2026-04-27 07:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c911216f-2756-541d-8dfc-2e18f22bded4, identifier: PS74193
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04f10>
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_b9f1c7e5f51f779fdf29326c8b33859e.jpg saved to cache
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3b3e7d5-3abe-5d35-b76e-575ad020762d
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3b3e7d5-3abe-5d35-b76e-575ad020762d, skipping ID generation
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b3e7d5-3abe-5d35-b76e-575ad020762d with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3b3e7d5-3abe-5d35-b76e-575ad020762d sending to next pipeline
2026-04-27 07:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3b3e7d5-3abe-5d35-b76e-575ad020762d, identifier: VY08054
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120d019b-1b5a-574d-8e66-7e7830bf3e39 with identifier: PB76196
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120d019b-1b5a-574d-8e66-7e7830bf3e39 with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_b06c0e58e406645bcbd09813b522c6ea.jpg not downloaded yet
2026-04-27 07:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1604e9b7-f546-5dca-91f4-3b7de42edcdf with identifier: KU34355
2026-04-27 07:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf with scrape type 1
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_b86efeedf096cec0013c8b5412d36b3c.jpg not downloaded yet
2026-04-27 07:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with identifier: PF85631
2026-04-27 07:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with identifier: PF85631
2026-04-27 07:59:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b2e2728-3e09-5bb2-a219-b3dac06e72b4 with identifier: PF85631 to the API
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_7b46c6defd83c03361b0576c525c44c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 212,
 'category': None,
 'city': 'Erbach',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:35:29Z',
 'fuel_type': 'petrol',
 'id': '3b2e2728-3e09-5bb2-a219-b3dac06e72b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF85631',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 59270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e614dc5144b0eeb6a4ce20035216d0a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_3f6077e5156e87bfcb477050ff821147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_e4c0ed16eff08edfb41354c4b2aad79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_79cda19292e695f35909dda101a32799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_56a72747e0aeafe54ed3ac6cd29a5e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_69280f4231aab7d5a646868ba09a0e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_bef0a6ce6bf9c7c6a39a3160b6afdbe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_f7498c8d250732d2ff4efd43b193201a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_a3266a42833035d70119fdef0060ed94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b2e2728-3e09-5bb2-a219-b3dac06e72b4/3b2e2728-3e09-5bb2-a219-b3dac06e72b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cd82816d79e636807d056690dc158/pa/PF85631_7b46c6defd83c03361b0576c525c44c0.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2019-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2019}
2026-04-27 07:59:08 [auto1.de] INFO: Saving data for PF85631: {'created_time': 1777276748.800594, 'last_price_update_time': 1777276748.800605, 'has_photos': True, 'auction_closing_time': 1777390529.0}
2026-04-27 07:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68a5ef8f-4576-53c4-83d8-15059c3afb5c with identifier: RV47209
2026-04-27 07:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68a5ef8f-4576-53c4-83d8-15059c3afb5c with identifier: RV47209
2026-04-27 07:59:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68a5ef8f-4576-53c4-83d8-15059c3afb5c with identifier: RV47209 to the API
2026-04-27 07:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_ecc0e59436728a8f84baff59c9ceadb8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Erbach',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:00:31Z',
 'fuel_type': 'petrol',
 'id': '68a5ef8f-4576-53c4-83d8-15059c3afb5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV47209',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 30328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_837ea9ab51ca14704b9eaa39894b0606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_e9cf6686c186306860e9f9c031f08bcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_91655bdfe7800535f3cac756e421361e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_2b36dca36028d534e569a575118c1def.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_57b0e5fd283f9e983e30940e931b5ca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_66dd18006b9788abd9942d171084a17c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_c76780ea813b4608d43ee1d895caedf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_ecc0e59436728a8f84baff59c9ceadb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_83e064c7a7f4c35d5052b973af656a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a5ef8f-4576-53c4-83d8-15059c3afb5c/68a5ef8f-4576-53c4-83d8-15059c3afb5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/f4/b3f45f2853ae5063f2f915ffe4de8b32/pa/RV47209_9d0d4b36317d8f552159be265e184404.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2020-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-04-27 07:59:09 [auto1.de] INFO: Saving data for RV47209: {'created_time': 1777276749.135863, 'last_price_update_time': 1777276749.135873, 'has_photos': True, 'auction_closing_time': 1777388431.0}
2026-04-27 07:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-04-27 07:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-04-27 07:59:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193 to the API
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_03586693fbe4cd20d1c54658472afe9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 260,
 'category': None,
 'city': 'Buch',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '4.8L',
 'engine_horse_power': 400,
 'expiration_date': '2026-04-28T15:23:57Z',
 'fuel_type': 'petrol',
 'id': 'c911216f-2756-541d-8dfc-2e18f22bded4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS74193',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 186600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_cc212b1e8e5b657ae7da4acb11771738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_800733a4eeee1d79bd69627afd14f09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4bf19cfea49ce8346470ff5997addd07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_9368105d0cb407bbcf1f3a54df91b3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_8bbfaac868f8e2c04c24ac014f5e2925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_4cb32e1e5c3994589ddcf9ac96750dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_ae32de73f8b76f35c886e205e8afd8ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_6286c179dd1231c614084c0dabf4d5d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_a6ce00a741c12eaa6bf81546d87f8cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c911216f-2756-541d-8dfc-2e18f22bded4/c911216f-2756-541d-8dfc-2e18f22bded4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/22/622264cd68f846fff02996d0a4b5de2a/pa/PS74193_03586693fbe4cd20d1c54658472afe9d.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2009-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-04-27 07:59:09 [auto1.de] INFO: Saving data for PS74193: {'created_time': 1777276749.447591, 'last_price_update_time': 1777276749.447601, 'has_photos': True, 'auction_closing_time': 1777389837.0}
2026-04-27 07:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-04-27 07:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-04-27 07:59:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054 to the API
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_b9f1c7e5f51f779fdf29326c8b33859e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'city': 'Germersheim',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:23:06Z',
 'fuel_type': 'petrol',
 'id': 'b3b3e7d5-3abe-5d35-b76e-575ad020762d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08054',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 83718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_3730df5263a9338386af125fd2a5fcef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_568f468aad0d8cf2f98cae0cbcc3c85d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_b9f1c7e5f51f779fdf29326c8b33859e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_da95bc19ac15c69f2163bfcffabb3b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e639b1e67a163a074e31cb8191df08f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_8e496a0c8c64c427f9fef9e03f7b13a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_084f98dbce023543fd8cd2cab1cd6d20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_48d155b195f88efe4b846369fdd2ba38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_18cd9254529b63a39a937ffed3f5a139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b3b3e7d5-3abe-5d35-b76e-575ad020762d/b3b3e7d5-3abe-5d35-b76e-575ad020762d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/54/1c54123c61320833198addb27f32dd8f/pa/VY08054_e1196b5d32cea302d60dc831fa91570e.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2010-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2010}
2026-04-27 07:59:09 [auto1.de] INFO: Saving data for VY08054: {'created_time': 1777276749.762871, 'last_price_update_time': 1777276749.762921, 'has_photos': True, 'auction_closing_time': 1777389786.0}
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_2cb7982f50d43f42316751462595e3ad.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_3cce81d9329f24e9796d1083df05d3e1.jpg not downloaded yet
2026-04-27 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED54075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_9e70421bf2d24a514d68c2577d1311dc.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_6d3d0d35e1decb83f1efaa291c52f242.jpg not downloaded yet
2026-04-27 07:59:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_6882f3a41e19f492da43691924404e54.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_368c7476e9f86cc4ceaa97684e9ce970.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_84acbbe598360a2cacf28e86d276dfe2.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_4d8d41b9eada7975e087369d9de6bcfc.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_68139450e50adbbd63931c59048e5afe.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_4cb9c4ec6fb26dd483a225e7e9817518.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_e1b6f914430b236b412d1ba7562ff23a.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_a5007ba20b77d9f75cf88fa3759f7cf7.jpg not downloaded yet
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_735b70879501e523251b830f844391ce.jpg not downloaded yet
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR97346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_735b70879501e523251b830f844391ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcee90>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_735b70879501e523251b830f844391ce.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB12781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_a5007ba20b77d9f75cf88fa3759f7cf7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22beb290>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_a5007ba20b77d9f75cf88fa3759f7cf7.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU46905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_e1b6f914430b236b412d1ba7562ff23a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb0d50>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_e1b6f914430b236b412d1ba7562ff23a.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL60015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH56807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.451(s), this was the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.392364364681293 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.373(s), this was the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.491647887825676 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.602(s), this was the 1st time calling it.
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.274158740689528 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB27376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ43291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_4cb9c4ec6fb26dd483a225e7e9817518.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT46165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS01283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9bb10>
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_4cb9c4ec6fb26dd483a225e7e9817518.jpg saved to cache
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_68139450e50adbbd63931c59048e5afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b52d90>
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_68139450e50adbbd63931c59048e5afe.jpg saved to cache
2026-04-27 07:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY50471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND93415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB12781> (referer: https://www.auto1.com/v1/car-details-view/BB12781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with identifier: BB12781
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_5c29fa9b86eb41ecd47370d4bf080606.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_3ede3d0a680c3b5c2cff54e4a6515a9e.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR97346> (referer: https://www.auto1.com/v1/car-details-view/VR97346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_73ea3e67a9650a20ff62b6b57ab997bc.jpg not downloaded yet
2026-04-27 07:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_e7304687d803f67293537bce4041ecff.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_477aebaaef16ddc3e1367f9f09b4b73e.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_8cce9a1dd34b6febbf1545a14e46d694.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_3ede3d0a680c3b5c2cff54e4a6515a9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_daf25e548a009d2dfd5424c6808cc2e4.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH77652> (referer: https://www.auto1.com/v1/car-details-view/BH77652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f65a92-1674-5fa2-864a-e2653bb1897f with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_1a7ae58851cf13ae2a3d1884e95fbe28.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_865977cc8ef3525e9260b1b33178dbee.jpg not downloaded yet
2026-04-27 07:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_031a96622c380bb211f1b5b1a323f208.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_18ec7488eaf30244f9f1425fd67d73e5.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_6d21e6100be439090703eaec2b144887.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU46905> (referer: https://www.auto1.com/v1/car-details-view/LU46905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_fb4ff0c59c6b44d86a4ffdbcd6d26c84.jpg not downloaded yet
2026-04-27 07:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_73594d9f237430f07f840e4535f36813.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9f1d445bcb023bf91ff9a9d0e85acde8.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75b10>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_3ede3d0a680c3b5c2cff54e4a6515a9e.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155d24b1-4e56-50c6-9471-c85eb25207cf with identifier: BH77652
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d24b1-4e56-50c6-9471-c85eb25207cf with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_048c594b718c3a9e91598c6c01de76a3.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_368379554fe4ae23f4d56e9d2f9c7c36.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_daf25e548a009d2dfd5424c6808cc2e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_7032233b80ebb95e76f6a903ea87c3a5.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_8cce9a1dd34b6febbf1545a14e46d694.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_f15f875549d540376ccabd75898d6514.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_1eda341bb3e48e78a8460789bd3184ab.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e750171204dea6dd270ea08a81a30f09.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9d9cdc238655af62b27fd121cb62d4ab.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_dffec17c661fb1346e25a18f87dcfb59.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_84dad2604dab46ce23aae776c057a540.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_13aabae2813c416c3cc0470e2f3dad33.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_3bbaa8bca3826992fdaa181a8ee65981.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e39173194b0d7c8fde966f5c5e507ab2.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_6d21e6100be439090703eaec2b144887.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_dde9a96cc649191a4a66a28e37b09d35.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_52be639073f66c6087da57be49052d18.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_62113104502eb7870ab15c70f46eea12.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b03010>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_daf25e548a009d2dfd5424c6808cc2e4.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0dd0>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_8cce9a1dd34b6febbf1545a14e46d694.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_5c6fb4bf6bbc18eebb15415916f5d77b.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_d9fe00e29755cc78c8c5b73f3688e3b8.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_048c594b718c3a9e91598c6c01de76a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_368379554fe4ae23f4d56e9d2f9c7c36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_8e2138da0ff296ad6eaa3e8a8190a8ac.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca34d0>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_6d21e6100be439090703eaec2b144887.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_90d74187cfe77b16b9f185a5090752b9.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_c26cee1e1840621a65f226e4fd31618e.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_19b25706562b2e3df83eee3bb0108d59.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_487eb3b0ec7791100ef79e712181499b.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_edcfe78313a4752d40087d28ec8e8121.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_afc35b802bf37573821273fe5536b105.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_ed2d50f2c2737dc370ea61053fc64bf8.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b650d0>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_048c594b718c3a9e91598c6c01de76a3.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dbd890>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_368379554fe4ae23f4d56e9d2f9c7c36.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e39173194b0d7c8fde966f5c5e507ab2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_5c6fb4bf6bbc18eebb15415916f5d77b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_62113104502eb7870ab15c70f46eea12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED54075> (referer: https://www.auto1.com/v1/car-details-view/ED54075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3025be90>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e39173194b0d7c8fde966f5c5e507ab2.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8bdd0>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_5c6fb4bf6bbc18eebb15415916f5d77b.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d210>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_62113104502eb7870ab15c70f46eea12.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-04-27 07:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114dc39d-095c-5474-937f-75f7fa36d414 with scrape type 1
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_4bfcc5da8eae32581108c7c08f755da9.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_afc35b802bf37573821273fe5536b105.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_ed2d50f2c2737dc370ea61053fc64bf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_edcfe78313a4752d40087d28ec8e8121.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_ec2eaeb4f4567c9a742a6afb435d2ff0.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_487eb3b0ec7791100ef79e712181499b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_33cfbee3da1cd1f25a756fc25e0388e5.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b5359cdd2090862b4380630e02653713.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b353330d89235472712e0b75b0c7f55a.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_8a47c423bffcd4110bb4795bbaad1095.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_4bfcc5da8eae32581108c7c08f755da9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_1c2ddd806f9d9e14184f0e97546dff85.jpg not downloaded yet
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a714d0>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_afc35b802bf37573821273fe5536b105.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_79b295f39de9083c71599b38fc21dd88.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_90d74187cfe77b16b9f185a5090752b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_17711a75750452388825f1f6cb43b33d.jpg not downloaded yet
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60710>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_ed2d50f2c2737dc370ea61053fc64bf8.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30179410>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_edcfe78313a4752d40087d28ec8e8121.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2f390>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_487eb3b0ec7791100ef79e712181499b.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_c26cee1e1840621a65f226e4fd31618e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_e7bae5a73d36b9136819b3f88f75a868.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_19b25706562b2e3df83eee3bb0108d59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c18890>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_4bfcc5da8eae32581108c7c08f755da9.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6b990>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_90d74187cfe77b16b9f185a5090752b9.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ43291> (referer: https://www.auto1.com/v1/car-details-view/YJ43291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_8a47c423bffcd4110bb4795bbaad1095.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_79b295f39de9083c71599b38fc21dd88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22be89d0>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_c26cee1e1840621a65f226e4fd31618e.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1410>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_19b25706562b2e3df83eee3bb0108d59.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_17711a75750452388825f1f6cb43b33d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_e7bae5a73d36b9136819b3f88f75a868.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b353330d89235472712e0b75b0c7f55a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-04-27 07:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 1
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_651ce9b8c7919fa64be1eb5ff7a04705.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_56d44d1224ed898488d6604e20c28ed5.jpg not downloaded yet
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4c590>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_8a47c423bffcd4110bb4795bbaad1095.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300eadd0>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_79b295f39de9083c71599b38fc21dd88.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_2b5b4bd79eebfc7d8106058f561aeba4.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_33cfbee3da1cd1f25a756fc25e0388e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_1c2ddd806f9d9e14184f0e97546dff85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b5359cdd2090862b4380630e02653713.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_13cf01f30759c026a2caf48364e45120.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL82940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1d390>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_17711a75750452388825f1f6cb43b33d.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9f1d0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_e7bae5a73d36b9136819b3f88f75a868.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee9e90>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b353330d89235472712e0b75b0c7f55a.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_158c7781c26bd93fcd9411f804483cb0.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_ec2eaeb4f4567c9a742a6afb435d2ff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_8e2138da0ff296ad6eaa3e8a8190a8ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_56d44d1224ed898488d6604e20c28ed5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_47646a69bb6d00f7ac6adf745ea653a3.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66a50>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_33cfbee3da1cd1f25a756fc25e0388e5.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed25d0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_1c2ddd806f9d9e14184f0e97546dff85.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9d6d0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b5359cdd2090862b4380630e02653713.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_651ce9b8c7919fa64be1eb5ff7a04705.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_0c37d79896abff09823803601857b62d.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc710>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_ec2eaeb4f4567c9a742a6afb435d2ff0.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 114dc39d-095c-5474-937f-75f7fa36d414
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 114dc39d-095c-5474-937f-75f7fa36d414, skipping ID generation
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114dc39d-095c-5474-937f-75f7fa36d414 with scrape type 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 114dc39d-095c-5474-937f-75f7fa36d414 sending to next pipeline
2026-04-27 07:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 114dc39d-095c-5474-937f-75f7fa36d414, identifier: ED54075
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebe8b90>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_8e2138da0ff296ad6eaa3e8a8190a8ac.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22feff10>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_56d44d1224ed898488d6604e20c28ed5.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_b5844fa2577e46f2e5767b04cbfe2795.jpg not downloaded yet
2026-04-27 07:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-04-27 07:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-04-27 07:59:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075 to the API
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_ec2eaeb4f4567c9a742a6afb435d2ff0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'city': 'Zörbig',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-04-28T15:45:30Z',
 'fuel_type': 'petrol',
 'id': '114dc39d-095c-5474-937f-75f7fa36d414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.6289,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED54075',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'location_confidence': 'geocoded',
 'longitude': 12.1174,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_4bfcc5da8eae32581108c7c08f755da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_ec2eaeb4f4567c9a742a6afb435d2ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_33cfbee3da1cd1f25a756fc25e0388e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b5359cdd2090862b4380630e02653713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_b353330d89235472712e0b75b0c7f55a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_8a47c423bffcd4110bb4795bbaad1095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_1c2ddd806f9d9e14184f0e97546dff85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_79b295f39de9083c71599b38fc21dd88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_17711a75750452388825f1f6cb43b33d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114dc39d-095c-5474-937f-75f7fa36d414/114dc39d-095c-5474-937f-75f7fa36d414_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/53/6f532fe4acb65177e3cc099fd46e8bae/pa/ED54075_e7bae5a73d36b9136819b3f88f75a868.jpg',
             'Width': 800}],
 'postal_code': '06780',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2017-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2017}
2026-04-27 07:59:24 [auto1.de] INFO: Saving data for ED54075: {'created_time': 1777276764.382725, 'last_price_update_time': 1777276764.382738, 'has_photos': True, 'auction_closing_time': 1777391130.0}
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_d9fe00e29755cc78c8c5b73f3688e3b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_13cf01f30759c026a2caf48364e45120.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_158c7781c26bd93fcd9411f804483cb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_2b5b4bd79eebfc7d8106058f561aeba4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH56807> (referer: https://www.auto1.com/v1/car-details-view/GH56807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_52be639073f66c6087da57be49052d18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_7210650d9d775a86d98bc71f5ef6f43f.jpg not downloaded yet
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB27376> (referer: https://www.auto1.com/v1/car-details-view/BB27376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL60015> (referer: https://www.auto1.com/v1/car-details-view/JL60015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF69216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eca3d0>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_651ce9b8c7919fa64be1eb5ff7a04705.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_ec2fd737556c9ad805a6fcced9722f7f.jpg not downloaded yet
2026-04-27 07:59:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ad2250>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_d9fe00e29755cc78c8c5b73f3688e3b8.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_13aabae2813c416c3cc0470e2f3dad33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ad2290>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_13cf01f30759c026a2caf48364e45120.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300db1d0>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_158c7781c26bd93fcd9411f804483cb0.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051d10>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_2b5b4bd79eebfc7d8106058f561aeba4.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-04-27 07:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with scrape type 1
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_3d6684debf809a2bc6ba1c7197f0d93a.jpg not downloaded yet
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa6450>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_52be639073f66c6087da57be49052d18.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_af9ecc367c296a69dac3659c6cc6a0d9.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_56cb885c4be2c19d5e855c43e3ecca2d.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_0c37d79896abff09823803601857b62d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_3bbaa8bca3826992fdaa181a8ee65981.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_84dad2604dab46ce23aae776c057a540.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_dde9a96cc649191a4a66a28e37b09d35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_47646a69bb6d00f7ac6adf745ea653a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_b5844fa2577e46f2e5767b04cbfe2795.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_dffec17c661fb1346e25a18f87dcfb59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_c95b6411d8807a8185449a7eabb661c6.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_08af02560648b6e753ce2589435deccb.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_e5c8d721fb4bd020bf33c0eaf9133042.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT46165> (referer: https://www.auto1.com/v1/car-details-view/ZT46165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f7a390>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_13aabae2813c416c3cc0470e2f3dad33.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_8cf0f82a71e7fbfe22fd2d3507c34739.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_59de994e6903a247c284446d97465f14.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_c63bb33569684c66cd974b0d36cd777a.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9d9cdc238655af62b27fd121cb62d4ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_1eda341bb3e48e78a8460789bd3184ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e750171204dea6dd270ea08a81a30f09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_d6f0dcb185fbc3ab41972d5f24b66862.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_704f4a825a14d9a07eea4d424dd34430.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_3f727958d0b8f9414ff4858cece6440d.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_3d6684debf809a2bc6ba1c7197f0d93a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_af9ecc367c296a69dac3659c6cc6a0d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_56cb885c4be2c19d5e855c43e3ecca2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb3950>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_0c37d79896abff09823803601857b62d.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b84250>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_3bbaa8bca3826992fdaa181a8ee65981.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a83290>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_84dad2604dab46ce23aae776c057a540.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a82210>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_dde9a96cc649191a4a66a28e37b09d35.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b855d0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_47646a69bb6d00f7ac6adf745ea653a3.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b4d0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_b5844fa2577e46f2e5767b04cbfe2795.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdf410>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_dffec17c661fb1346e25a18f87dcfb59.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_ec2fd737556c9ad805a6fcced9722f7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_21c65021bae53822ddc2a39272f3379f.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_69796a152cdcd53b337bc58e118994f5.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_bca2c30be1d6f4724a662803d8b6ae37.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with identifier: ZT46165
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_6455fbcd465552e9aa6e8cfcedc009ef.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_e5c8d721fb4bd020bf33c0eaf9133042.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_f15f875549d540376ccabd75898d6514.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_7210650d9d775a86d98bc71f5ef6f43f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_553421fa5586a5ad968489ddc91ebf2e.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_557697ce6188d0a15f357a08bdcd3728.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_8d779b0d9ba69b47bf445629865e01fa.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_b5ceaec8bb35c7a8e28be479d5042dde.jpg not downloaded yet
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300afed0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9d9cdc238655af62b27fd121cb62d4ab.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf09d0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_1eda341bb3e48e78a8460789bd3184ab.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d, skipping ID generation
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d sending to next pipeline
2026-04-27 07:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d, identifier: LU46905
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c21d10>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e750171204dea6dd270ea08a81a30f09.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce4ed0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_3d6684debf809a2bc6ba1c7197f0d93a.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f121d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_af9ecc367c296a69dac3659c6cc6a0d9.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad4d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_56cb885c4be2c19d5e855c43e3ecca2d.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-04-27 07:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-04-27 07:59:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905 to the API
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_1eda341bb3e48e78a8460789bd3184ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Schkopau',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:31:40Z',
 'fuel_type': 'petrol',
 'id': '977a70bd-e3e7-5a4e-bb0c-49274ee2796d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU46905',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 91592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_1eda341bb3e48e78a8460789bd3184ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_dffec17c661fb1346e25a18f87dcfb59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_3bbaa8bca3826992fdaa181a8ee65981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_52be639073f66c6087da57be49052d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_5c6fb4bf6bbc18eebb15415916f5d77b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_8e2138da0ff296ad6eaa3e8a8190a8ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_c26cee1e1840621a65f226e4fd31618e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_487eb3b0ec7791100ef79e712181499b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_afc35b802bf37573821273fe5536b105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_977a70bd-e3e7-5a4e-bb0c-49274ee2796d/977a70bd-e3e7-5a4e-bb0c-49274ee2796d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d1/d3d1a9624dfa330af32fac6a03891f8e/pa/LU46905_ed2d50f2c2737dc370ea61053fc64bf8.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2016-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-04-27 07:59:26 [auto1.de] INFO: Saving data for LU46905: {'created_time': 1777276766.753508, 'last_price_update_time': 1777276766.753517, 'has_photos': True, 'auction_closing_time': 1777390300.0}
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_57c5de672d4d4a1b3a14376a2e638238.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_87a9f5a3433e604bd6b6654d726f96c0.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_17601135ff2fb31a65f663b53167b21e.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_7179ce867eda2404e1b4467b0e1047fe.jpg not downloaded yet
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_3f727958d0b8f9414ff4858cece6440d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_08af02560648b6e753ce2589435deccb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_59de994e6903a247c284446d97465f14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_8cf0f82a71e7fbfe22fd2d3507c34739.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_c63bb33569684c66cd974b0d36cd777a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_c95b6411d8807a8185449a7eabb661c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND93415> (referer: https://www.auto1.com/v1/car-details-view/ND93415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS01283> (referer: https://www.auto1.com/v1/car-details-view/NS01283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b62950>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_ec2fd737556c9ad805a6fcced9722f7f.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db5550>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_e5c8d721fb4bd020bf33c0eaf9133042.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e278d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_f15f875549d540376ccabd75898d6514.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6f50>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_7210650d9d775a86d98bc71f5ef6f43f.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23116f69-c0ba-586f-93e6-e50eb7ad0720
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23116f69-c0ba-586f-93e6-e50eb7ad0720, skipping ID generation
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 1
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 sending to next pipeline
2026-04-27 07:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23116f69-c0ba-586f-93e6-e50eb7ad0720, identifier: YJ43291
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_012e9803b2c93956910de145f44dee40.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_337e14b2e03bb1e2e8f2dad7af1ebe76.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_82a81da94c29aba03e0f1a98bfa26fa9.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_66056bd19434a0763e474136d0df55be.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-04-27 07:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-04-27 07:59:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291 to the API
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_7210650d9d775a86d98bc71f5ef6f43f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Kerpen',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:11:57Z',
 'fuel_type': 'petrol',
 'id': '23116f69-c0ba-586f-93e6-e50eb7ad0720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ43291',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 78207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_651ce9b8c7919fa64be1eb5ff7a04705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_56d44d1224ed898488d6604e20c28ed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_2b5b4bd79eebfc7d8106058f561aeba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_13cf01f30759c026a2caf48364e45120.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_158c7781c26bd93fcd9411f804483cb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_47646a69bb6d00f7ac6adf745ea653a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_0c37d79896abff09823803601857b62d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_b5844fa2577e46f2e5767b04cbfe2795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_7210650d9d775a86d98bc71f5ef6f43f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_23116f69-c0ba-586f-93e6-e50eb7ad0720/23116f69-c0ba-586f-93e6-e50eb7ad0720_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/ba/18baaa9a149a629cc8fd7ddf40fbcbc3/pa/YJ43291_ec2fd737556c9ad805a6fcced9722f7f.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2008-06-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-04-27 07:59:27 [auto1.de] INFO: Saving data for YJ43291: {'created_time': 1777276767.622651, 'last_price_update_time': 1777276767.622661, 'has_photos': True, 'auction_closing_time': 1777389117.0}
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_6455fbcd465552e9aa6e8cfcedc009ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_69796a152cdcd53b337bc58e118994f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_bca2c30be1d6f4724a662803d8b6ae37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_286dd4bd4310a6a073b5a56e49942e2a.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_e2306e0c5245bbc8b42fdda5d781eb91.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_201eb2f91c7c964ca25eec7af6302b81.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_26930a0b6d509286e0020e10633b1b81.jpg not downloaded yet
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c2390>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_3f727958d0b8f9414ff4858cece6440d.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8be90>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_08af02560648b6e753ce2589435deccb.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300db2d0>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_59de994e6903a247c284446d97465f14.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d303095d0>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_8cf0f82a71e7fbfe22fd2d3507c34739.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcdc90>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_c63bb33569684c66cd974b0d36cd777a.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8b290>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_c95b6411d8807a8185449a7eabb661c6.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with identifier: ND93415
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with scrape type 1
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_0698ca78cbe28ca035f3c04e70bc5606.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522c6924-8d04-5d4e-b932-bd172ce7c8ac with identifier: NS01283
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac with scrape type 1
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_f2ecd5e259a48c3fc2ad839541a225e0.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_704f4a825a14d9a07eea4d424dd34430.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_1c10b8359aaafb7b100d20587898dc22.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_8c6f53a82f598eb30dde634b47e71600.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_b127b1c46dadca70e49b6b24db445754.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_5d315af51c94fbf1f75740ccc9ea7d79.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_51e109f16bed8fca5c07402f1d599142.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_b5ceaec8bb35c7a8e28be479d5042dde.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_21c65021bae53822ddc2a39272f3379f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_557697ce6188d0a15f357a08bdcd3728.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_8d779b0d9ba69b47bf445629865e01fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_553421fa5586a5ad968489ddc91ebf2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY50471> (referer: https://www.auto1.com/v1/car-details-view/DY50471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_6768bb4ebb4ad8545d3fa2e4048899a3.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_57b74ead6c5b9ff987973f4ef13d7506.jpg not downloaded yet
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bbed0>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_6455fbcd465552e9aa6e8cfcedc009ef.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b10c50>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_69796a152cdcd53b337bc58e118994f5.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30285e90>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_bca2c30be1d6f4724a662803d8b6ae37.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cfe10>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_704f4a825a14d9a07eea4d424dd34430.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_17601135ff2fb31a65f663b53167b21e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_87a9f5a3433e604bd6b6654d726f96c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_3c18177c266bcbcd89c34b97b4c48f8c.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_e2e34ca827520848861dfaddcf53c854.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_7179ce867eda2404e1b4467b0e1047fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_f2ecd5e259a48c3fc2ad839541a225e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_82a81da94c29aba03e0f1a98bfa26fa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_66056bd19434a0763e474136d0df55be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee8490>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_b5ceaec8bb35c7a8e28be479d5042dde.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053a90>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_21c65021bae53822ddc2a39272f3379f.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14350>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_557697ce6188d0a15f357a08bdcd3728.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c44fd0>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_8d779b0d9ba69b47bf445629865e01fa.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb6250>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_553421fa5586a5ad968489ddc91ebf2e.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2332b550-32b0-5174-95c0-b060f97da375 with identifier: DY50471
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2332b550-32b0-5174-95c0-b060f97da375 with scrape type 1
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_ea21ed2232aa1c324b006fa268626161.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_0698ca78cbe28ca035f3c04e70bc5606.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_4b40b632ecc33888583f4db6025ba54b.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0b5ae73dd96240576e6dd95522d393d2.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_3337f7cb6de154c1128048e3a4b9fca5.jpg not downloaded yet
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_26930a0b6d509286e0020e10633b1b81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_7b4d775e5c8b83a0a4dec29a298e6879.jpg not downloaded yet
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301642d0>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_17601135ff2fb31a65f663b53167b21e.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb0c90>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_87a9f5a3433e604bd6b6654d726f96c0.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e04e50>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_7179ce867eda2404e1b4467b0e1047fe.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b62250>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_f2ecd5e259a48c3fc2ad839541a225e0.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c13e10>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_82a81da94c29aba03e0f1a98bfa26fa9.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c13f50>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_66056bd19434a0763e474136d0df55be.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_00a19a783eda4b5c637268e2f77f71bd.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_286dd4bd4310a6a073b5a56e49942e2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_201eb2f91c7c964ca25eec7af6302b81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_57b74ead6c5b9ff987973f4ef13d7506.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_6768bb4ebb4ad8545d3fa2e4048899a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_e2306e0c5245bbc8b42fdda5d781eb91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_5d315af51c94fbf1f75740ccc9ea7d79.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_51e109f16bed8fca5c07402f1d599142.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_23ddda6c21bc091a1ede499aab6923d9.jpg not downloaded yet
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_34d770a0aec70610dec60ba2fd1356dd.jpg not downloaded yet
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b99c50>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_0698ca78cbe28ca035f3c04e70bc5606.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b99090>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_26930a0b6d509286e0020e10633b1b81.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66
2026-04-27 07:59:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66, skipping ID generation
2026-04-27 07:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with scrape type 1
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 sending to next pipeline
2026-04-27 07:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66, identifier: ZT46165
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_a368570afcf220dab695c30298f59214.jpg not downloaded yet
2026-04-27 07:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with identifier: ZT46165
2026-04-27 07:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with identifier: ZT46165
2026-04-27 07:59:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66 with identifier: ZT46165 to the API
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_26930a0b6d509286e0020e10633b1b81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Zörbig',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:58:02Z',
 'fuel_type': 'petrol',
 'id': 'ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.6289,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT46165',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'location_confidence': 'geocoded',
 'longitude': 12.1174,
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 248697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_6455fbcd465552e9aa6e8cfcedc009ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_b5ceaec8bb35c7a8e28be479d5042dde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_7179ce867eda2404e1b4467b0e1047fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_66056bd19434a0763e474136d0df55be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66/ff95b9b2-e11f-5c0f-b5e2-f61df5c20b66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/86/7486b0cc1033da58860c6cbab9788077/pa/ZT46165_26930a0b6d509286e0020e10633b1b81.jpg',
             'Width': 800}],
 'postal_code': '06780',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2003-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.6 VTEC ES',
 'transmission': 'manual',
 'trim': 'ES',
 'year': 2003}
2026-04-27 07:59:30 [auto1.de] INFO: Saving data for ZT46165: {'created_time': 1777276770.554853, 'last_price_update_time': 1777276770.554862, 'has_photos': True, 'auction_closing_time': 1777391882.0}
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_d0e2c2c2af0c4da7258c27989da86608.jpg not downloaded yet
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_b127b1c46dadca70e49b6b24db445754.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_ac2d9b8dd3fdb1cac2a7fe3fd66ad2a2.jpg not downloaded yet
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF69216> (referer: https://www.auto1.com/v1/car-details-view/NF69216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189810>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_286dd4bd4310a6a073b5a56e49942e2a.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0bb90>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_201eb2f91c7c964ca25eec7af6302b81.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc8310>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_57b74ead6c5b9ff987973f4ef13d7506.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee3f50>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_6768bb4ebb4ad8545d3fa2e4048899a3.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8a790>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_e2306e0c5245bbc8b42fdda5d781eb91.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0ac50>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_5d315af51c94fbf1f75740ccc9ea7d79.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc8ed0>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_51e109f16bed8fca5c07402f1d599142.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0b5ae73dd96240576e6dd95522d393d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_e2e34ca827520848861dfaddcf53c854.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_8c6f53a82f598eb30dde634b47e71600.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_1c10b8359aaafb7b100d20587898dc22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_abeb6dcb28c57651d8abc39be98d3d0d.jpg not downloaded yet
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0940389282fe117ec2d54fe3ad0bce1b.jpg not downloaded yet
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_3337f7cb6de154c1128048e3a4b9fca5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_00a19a783eda4b5c637268e2f77f71bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_7b4d775e5c8b83a0a4dec29a298e6879.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167c10>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_b127b1c46dadca70e49b6b24db445754.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f, skipping ID generation
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with scrape type 1
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f sending to next pipeline
2026-04-27 07:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f, identifier: JL60015
2026-04-27 07:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0983d4a3-c625-5345-8194-0ed25e39a061 with identifier: NF69216
2026-04-27 07:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0983d4a3-c625-5345-8194-0ed25e39a061 with scrape type 1
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_7353f3261e172c959abbd9da1911d52c.jpg not downloaded yet
2026-04-27 07:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-04-27 07:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015
2026-04-27 07:59:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f with identifier: JL60015 to the API
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_b127b1c46dadca70e49b6b24db445754.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Kerpen',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:17:08Z',
 'fuel_type': 'diesel',
 'id': '43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL60015',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Audi',
 'model': 'A1',
 'odometer': 273685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_56cb885c4be2c19d5e855c43e3ecca2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_e5c8d721fb4bd020bf33c0eaf9133042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_c63bb33569684c66cd974b0d36cd777a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_3f727958d0b8f9414ff4858cece6440d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_bca2c30be1d6f4724a662803d8b6ae37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_8d779b0d9ba69b47bf445629865e01fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_17601135ff2fb31a65f663b53167b21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_82a81da94c29aba03e0f1a98bfa26fa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_201eb2f91c7c964ca25eec7af6302b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f/43a7aa9e-f324-5cf6-8657-5cf7bcb1c55f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/0c/f60c405716012c8e9dcd0e89b65bb8bc/pa/JL60015_b127b1c46dadca70e49b6b24db445754.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2012-02-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-04-27 07:59:32 [auto1.de] INFO: Saving data for JL60015: {'created_time': 1777276772.083288, 'last_price_update_time': 1777276772.083298, 'has_photos': True, 'auction_closing_time': 1777389428.0}
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_4b40b632ecc33888583f4db6025ba54b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_ea21ed2232aa1c324b006fa268626161.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_a8ac3d7d508a7098945e2bd3d046dafe.jpg not downloaded yet
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_23ddda6c21bc091a1ede499aab6923d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_a368570afcf220dab695c30298f59214.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_337e14b2e03bb1e2e8f2dad7af1ebe76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_3c18177c266bcbcd89c34b97b4c48f8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_34d770a0aec70610dec60ba2fd1356dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_d0e2c2c2af0c4da7258c27989da86608.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_593cf35dccdc1faf1248c0239e526e75.jpg not downloaded yet
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fbde90>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0b5ae73dd96240576e6dd95522d393d2.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b79410>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_e2e34ca827520848861dfaddcf53c854.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ad1b10>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_8c6f53a82f598eb30dde634b47e71600.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee0550>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_1c10b8359aaafb7b100d20587898dc22.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302b5550>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_3337f7cb6de154c1128048e3a4b9fca5.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3030b810>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_00a19a783eda4b5c637268e2f77f71bd.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd60d0>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_7b4d775e5c8b83a0a4dec29a298e6879.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_57c5de672d4d4a1b3a14376a2e638238.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_d6f0dcb185fbc3ab41972d5f24b66862.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_48164995f50d1df5033291a1f6ca2276.jpg not downloaded yet
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_7353f3261e172c959abbd9da1911d52c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_ac2d9b8dd3fdb1cac2a7fe3fd66ad2a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_012e9803b2c93956910de145f44dee40.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_abeb6dcb28c57651d8abc39be98d3d0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004fbd0>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_4b40b632ecc33888583f4db6025ba54b.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93290>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_ea21ed2232aa1c324b006fa268626161.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d84b50>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_23ddda6c21bc091a1ede499aab6923d9.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f863d0>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_a368570afcf220dab695c30298f59214.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d86450>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_337e14b2e03bb1e2e8f2dad7af1ebe76.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc, skipping ID generation
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 1
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc sending to next pipeline
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc, identifier: BB27376
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a55d90>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_3c18177c266bcbcd89c34b97b4c48f8c.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744
2026-04-27 07:59:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744, skipping ID generation
2026-04-27 07:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with scrape type 1
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 sending to next pipeline
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744, identifier: ND93415
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34290>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_34d770a0aec70610dec60ba2fd1356dd.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e938d0>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_d0e2c2c2af0c4da7258c27989da86608.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_87306a70d234aee454bed744e799cf2e.jpg not downloaded yet
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_337e14b2e03bb1e2e8f2dad7af1ebe76.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'city': 'Ketzin',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:09:54Z',
 'fuel_type': 'diesel',
 'id': '13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB27376',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 204104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_af9ecc367c296a69dac3659c6cc6a0d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_08af02560648b6e753ce2589435deccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_59de994e6903a247c284446d97465f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_704f4a825a14d9a07eea4d424dd34430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_69796a152cdcd53b337bc58e118994f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_557697ce6188d0a15f357a08bdcd3728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_87a9f5a3433e604bd6b6654d726f96c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_337e14b2e03bb1e2e8f2dad7af1ebe76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_e2306e0c5245bbc8b42fdda5d781eb91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc/13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a443facbae4c58b23b85865e73cabce4/pa/BB27376_8c6f53a82f598eb30dde634b47e71600.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2016-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-04-27 07:59:33 [auto1.de] INFO: Saving data for BB27376: {'created_time': 1777276773.646347, 'last_price_update_time': 1777276773.646359, 'has_photos': True, 'auction_closing_time': 1777388994.0}
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with identifier: ND93415
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with identifier: ND93415
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744 with identifier: ND93415 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_3c18177c266bcbcd89c34b97b4c48f8c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'city': 'Karlskron',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:39:23Z',
 'fuel_type': 'diesel',
 'id': '8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND93415',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 120456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_0698ca78cbe28ca035f3c04e70bc5606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_5d315af51c94fbf1f75740ccc9ea7d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_6768bb4ebb4ad8545d3fa2e4048899a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_3c18177c266bcbcd89c34b97b4c48f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744/8d3a0521-d1c3-5cfc-ae8d-c6656cfa0744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/00/0e0089df5ef825ab2e7b53f33c7ffc7f/pa/ND93415_4b40b632ecc33888583f4db6025ba54b.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-04-27 07:59:34 [auto1.de] INFO: Saving data for ND93415: {'created_time': 1777276774.072755, 'last_price_update_time': 1777276774.072766, 'has_photos': True, 'auction_closing_time': 1777390763.0}
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0940389282fe117ec2d54fe3ad0bce1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_fb4ff0c59c6b44d86a4ffdbcd6d26c84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_7032233b80ebb95e76f6a903ea87c3a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_dedef4d4aa62ff68513d9ef550f527fd.jpg not downloaded yet
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301b5750>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_57c5de672d4d4a1b3a14376a2e638238.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcca90>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_d6f0dcb185fbc3ab41972d5f24b66862.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35bd0>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_7353f3261e172c959abbd9da1911d52c.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea2590>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_ac2d9b8dd3fdb1cac2a7fe3fd66ad2a2.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d690>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_012e9803b2c93956910de145f44dee40.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2434ec9-72d9-50f9-8ca3-c97dbfeece43, skipping ID generation
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with scrape type 1
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43 sending to next pipeline
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2434ec9-72d9-50f9-8ca3-c97dbfeece43, identifier: GH56807
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a1f10>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_abeb6dcb28c57651d8abc39be98d3d0d.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2332b550-32b0-5174-95c0-b060f97da375
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2332b550-32b0-5174-95c0-b060f97da375, skipping ID generation
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2332b550-32b0-5174-95c0-b060f97da375 with scrape type 1
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2332b550-32b0-5174-95c0-b060f97da375 sending to next pipeline
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2332b550-32b0-5174-95c0-b060f97da375, identifier: DY50471
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_a8ac3d7d508a7098945e2bd3d046dafe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_73594d9f237430f07f840e4535f36813.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9f1d445bcb023bf91ff9a9d0e85acde8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_18ec7488eaf30244f9f1425fd67d73e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-04-27 07:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-04-27 07:59:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807 to the API
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_012e9803b2c93956910de145f44dee40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:40:35Z',
 'fuel_type': 'diesel',
 'id': 'e2434ec9-72d9-50f9-8ca3-c97dbfeece43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH56807',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 179809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_3d6684debf809a2bc6ba1c7197f0d93a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_c95b6411d8807a8185449a7eabb661c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_8cf0f82a71e7fbfe22fd2d3507c34739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_d6f0dcb185fbc3ab41972d5f24b66862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_21c65021bae53822ddc2a39272f3379f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_553421fa5586a5ad968489ddc91ebf2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_57c5de672d4d4a1b3a14376a2e638238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_012e9803b2c93956910de145f44dee40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_286dd4bd4310a6a073b5a56e49942e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2434ec9-72d9-50f9-8ca3-c97dbfeece43/e2434ec9-72d9-50f9-8ca3-c97dbfeece43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/a6/b6a65b919dfbdf6ff6f9eb066a066914/pa/GH56807_1c10b8359aaafb7b100d20587898dc22.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2013-06-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-04-27 07:59:35 [auto1.de] INFO: Saving data for GH56807: {'created_time': 1777276775.068357, 'last_price_update_time': 1777276775.06837, 'has_photos': True, 'auction_closing_time': 1777390835.0}
2026-04-27 07:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2332b550-32b0-5174-95c0-b060f97da375 with identifier: DY50471
2026-04-27 07:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2332b550-32b0-5174-95c0-b060f97da375 with identifier: DY50471
2026-04-27 07:59:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2332b550-32b0-5174-95c0-b060f97da375 with identifier: DY50471 to the API
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_abeb6dcb28c57651d8abc39be98d3d0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'city': 'Atting',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:40:47Z',
 'fuel_type': 'diesel',
 'id': '2332b550-32b0-5174-95c0-b060f97da375',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY50471',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 331338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_ea21ed2232aa1c324b006fa268626161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_3337f7cb6de154c1128048e3a4b9fca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_00a19a783eda4b5c637268e2f77f71bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_34d770a0aec70610dec60ba2fd1356dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_d0e2c2c2af0c4da7258c27989da86608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2332b550-32b0-5174-95c0-b060f97da375/2332b550-32b0-5174-95c0-b060f97da375_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/25/3125cb4f5fd726ac101908a429bc8a63/pa/DY50471_abeb6dcb28c57651d8abc39be98d3d0d.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2010-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2010}
2026-04-27 07:59:35 [auto1.de] INFO: Saving data for DY50471: {'created_time': 1777276775.402939, 'last_price_update_time': 1777276775.402947, 'has_photos': True, 'auction_closing_time': 1777390847.0}
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_9d35cf918321c6d672acab6a95fa2615.jpg not downloaded yet
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_593cf35dccdc1faf1248c0239e526e75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_1a7ae58851cf13ae2a3d1884e95fbe28.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_031a96622c380bb211f1b5b1a323f208.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_865977cc8ef3525e9260b1b33178dbee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_6d249c34f633dec7b1b7028f52dca050.jpg not downloaded yet
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_e7304687d803f67293537bce4041ecff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c31250>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0940389282fe117ec2d54fe3ad0bce1b.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac
2026-04-27 07:59:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 522c6924-8d04-5d4e-b932-bd172ce7c8ac, skipping ID generation
2026-04-27 07:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac with scrape type 1
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 522c6924-8d04-5d4e-b932-bd172ce7c8ac sending to next pipeline
2026-04-27 07:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 522c6924-8d04-5d4e-b932-bd172ce7c8ac, identifier: NS01283
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2a490>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_fb4ff0c59c6b44d86a4ffdbcd6d26c84.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a49090>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_7032233b80ebb95e76f6a903ea87c3a5.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 155d24b1-4e56-50c6-9471-c85eb25207cf
2026-04-27 07:59:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 155d24b1-4e56-50c6-9471-c85eb25207cf, skipping ID generation
2026-04-27 07:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d24b1-4e56-50c6-9471-c85eb25207cf with scrape type 1
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 155d24b1-4e56-50c6-9471-c85eb25207cf sending to next pipeline
2026-04-27 07:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 155d24b1-4e56-50c6-9471-c85eb25207cf, identifier: BH77652
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c810>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_a8ac3d7d508a7098945e2bd3d046dafe.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e05b90>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_73594d9f237430f07f840e4535f36813.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc3550>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9f1d445bcb023bf91ff9a9d0e85acde8.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a80450>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_18ec7488eaf30244f9f1425fd67d73e5.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_87306a70d234aee454bed744e799cf2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_48164995f50d1df5033291a1f6ca2276.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_477aebaaef16ddc3e1367f9f09b4b73e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_8a89e1decf0625f3f627814035e527e2.jpg not downloaded yet
2026-04-27 07:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 522c6924-8d04-5d4e-b932-bd172ce7c8ac with identifier: NS01283
2026-04-27 07:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 522c6924-8d04-5d4e-b932-bd172ce7c8ac with identifier: NS01283
2026-04-27 07:59:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 522c6924-8d04-5d4e-b932-bd172ce7c8ac with identifier: NS01283 to the API
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0940389282fe117ec2d54fe3ad0bce1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:30:45Z',
 'fuel_type': 'petrol',
 'id': '522c6924-8d04-5d4e-b932-bd172ce7c8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS01283',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 52377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_f2ecd5e259a48c3fc2ad839541a225e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_51e109f16bed8fca5c07402f1d599142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_57b74ead6c5b9ff987973f4ef13d7506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_e2e34ca827520848861dfaddcf53c854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0b5ae73dd96240576e6dd95522d393d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_7b4d775e5c8b83a0a4dec29a298e6879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_23ddda6c21bc091a1ede499aab6923d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_a368570afcf220dab695c30298f59214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_ac2d9b8dd3fdb1cac2a7fe3fd66ad2a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_522c6924-8d04-5d4e-b932-bd172ce7c8ac/522c6924-8d04-5d4e-b932-bd172ce7c8ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e6/88e6b205fc05f3c425f54e05605bca3e/pa/NS01283_0940389282fe117ec2d54fe3ad0bce1b.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2019-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-04-27 07:59:36 [auto1.de] INFO: Saving data for NS01283: {'created_time': 1777276776.490856, 'last_price_update_time': 1777276776.490865, 'has_photos': True, 'auction_closing_time': 1777390245.0}
2026-04-27 07:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 155d24b1-4e56-50c6-9471-c85eb25207cf with identifier: BH77652
2026-04-27 07:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 155d24b1-4e56-50c6-9471-c85eb25207cf with identifier: BH77652
2026-04-27 07:59:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 155d24b1-4e56-50c6-9471-c85eb25207cf with identifier: BH77652 to the API
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_7032233b80ebb95e76f6a903ea87c3a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Kerpen',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:05:20Z',
 'fuel_type': 'petrol',
 'id': '155d24b1-4e56-50c6-9471-c85eb25207cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH77652',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 115104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_048c594b718c3a9e91598c6c01de76a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_7032233b80ebb95e76f6a903ea87c3a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e750171204dea6dd270ea08a81a30f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_84dad2604dab46ce23aae776c057a540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_e39173194b0d7c8fde966f5c5e507ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_62113104502eb7870ab15c70f46eea12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_d9fe00e29755cc78c8c5b73f3688e3b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_90d74187cfe77b16b9f185a5090752b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_19b25706562b2e3df83eee3bb0108d59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_155d24b1-4e56-50c6-9471-c85eb25207cf/155d24b1-4e56-50c6-9471-c85eb25207cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/10/a2105d1dd9d558460a0d1626c0782382/pa/BH77652_edcfe78313a4752d40087d28ec8e8121.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-04-27 07:59:36 [auto1.de] INFO: Saving data for BH77652: {'created_time': 1777276776.802174, 'last_price_update_time': 1777276776.802184, 'has_photos': True, 'auction_closing_time': 1777388720.0}
2026-04-27 07:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_73ea3e67a9650a20ff62b6b57ab997bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_0ce3cd902fe7daf15769c55f9ddbde78.jpg not downloaded yet
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46c50>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_593cf35dccdc1faf1248c0239e526e75.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301592d0>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_1a7ae58851cf13ae2a3d1884e95fbe28.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eea710>
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_031a96622c380bb211f1b5b1a323f208.jpg saved to cache
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3f65a92-1674-5fa2-864a-e2653bb1897f
2026-04-27 07:59:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3f65a92-1674-5fa2-864a-e2653bb1897f, skipping ID generation
2026-04-27 07:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f65a92-1674-5fa2-864a-e2653bb1897f with scrape type 1
2026-04-27 07:59:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3f65a92-1674-5fa2-864a-e2653bb1897f sending to next pipeline
2026-04-27 07:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3f65a92-1674-5fa2-864a-e2653bb1897f, identifier: VR97346
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa7ed0>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_865977cc8ef3525e9260b1b33178dbee.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4df50>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_e7304687d803f67293537bce4041ecff.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_5c29fa9b86eb41ecd47370d4bf080606.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_4d8d41b9eada7975e087369d9de6bcfc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_84acbbe598360a2cacf28e86d276dfe2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_dedef4d4aa62ff68513d9ef550f527fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-04-27 07:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-04-27 07:59:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346 to the API
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_031a96622c380bb211f1b5b1a323f208.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Helvesiek',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:43:07Z',
 'fuel_type': 'diesel',
 'id': 'a3f65a92-1674-5fa2-864a-e2653bb1897f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.2161,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR97346',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'location_confidence': 'geocoded',
 'longitude': 9.4915,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_1a7ae58851cf13ae2a3d1884e95fbe28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_031a96622c380bb211f1b5b1a323f208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_6d21e6100be439090703eaec2b144887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_73594d9f237430f07f840e4535f36813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9f1d445bcb023bf91ff9a9d0e85acde8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_368379554fe4ae23f4d56e9d2f9c7c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_f15f875549d540376ccabd75898d6514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_9d9cdc238655af62b27fd121cb62d4ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_13aabae2813c416c3cc0470e2f3dad33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f65a92-1674-5fa2-864a-e2653bb1897f/a3f65a92-1674-5fa2-864a-e2653bb1897f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/19/3a199e793b8de5db33aed58537763b2d/pa/VR97346_dde9a96cc649191a4a66a28e37b09d35.jpg',
             'Width': 800}],
 'postal_code': '27389',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2019}
2026-04-27 07:59:37 [auto1.de] INFO: Saving data for VR97346: {'created_time': 1777276777.486493, 'last_price_update_time': 1777276777.486505, 'has_photos': True, 'auction_closing_time': 1777390987.0}
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebbad10>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_87306a70d234aee454bed744e799cf2e.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd6c10>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_48164995f50d1df5033291a1f6ca2276.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1cc90>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_477aebaaef16ddc3e1367f9f09b4b73e.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_368c7476e9f86cc4ceaa97684e9ce970.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_6882f3a41e19f492da43691924404e54.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_9d35cf918321c6d672acab6a95fa2615.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_6d3d0d35e1decb83f1efaa291c52f242.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3790>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_73ea3e67a9650a20ff62b6b57ab997bc.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b74ad0>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_5c29fa9b86eb41ecd47370d4bf080606.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777
2026-04-27 07:59:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d0b1bbe-132a-5d76-934c-9d8e15faa777, skipping ID generation
2026-04-27 07:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with scrape type 1
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d0b1bbe-132a-5d76-934c-9d8e15faa777 sending to next pipeline
2026-04-27 07:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d0b1bbe-132a-5d76-934c-9d8e15faa777, identifier: BB12781
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1d10>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_4d8d41b9eada7975e087369d9de6bcfc.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea1090>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_84acbbe598360a2cacf28e86d276dfe2.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ec9610>
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_dedef4d4aa62ff68513d9ef550f527fd.jpg saved to cache
2026-04-27 07:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with identifier: BB12781
2026-04-27 07:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with identifier: BB12781
2026-04-27 07:59:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d0b1bbe-132a-5d76-934c-9d8e15faa777 with identifier: BB12781 to the API
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_5c29fa9b86eb41ecd47370d4bf080606.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Zülpich',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:32:09Z',
 'fuel_type': 'petrol',
 'id': '8d0b1bbe-132a-5d76-934c-9d8e15faa777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB12781',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 36024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_5c29fa9b86eb41ecd47370d4bf080606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_3ede3d0a680c3b5c2cff54e4a6515a9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_73ea3e67a9650a20ff62b6b57ab997bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_e7304687d803f67293537bce4041ecff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_477aebaaef16ddc3e1367f9f09b4b73e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_8cce9a1dd34b6febbf1545a14e46d694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_daf25e548a009d2dfd5424c6808cc2e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_865977cc8ef3525e9260b1b33178dbee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_18ec7488eaf30244f9f1425fd67d73e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d0b1bbe-132a-5d76-934c-9d8e15faa777/8d0b1bbe-132a-5d76-934c-9d8e15faa777_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/1b/c91b0893deea17c073e78963525dc5ef/pa/BB12781_fb4ff0c59c6b44d86a4ffdbcd6d26c84.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-04-27 07:59:38 [auto1.de] INFO: Saving data for BB12781: {'created_time': 1777276778.238653, 'last_price_update_time': 1777276778.238667, 'has_photos': True, 'auction_closing_time': 1777390329.0}
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_b86efeedf096cec0013c8b5412d36b3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_6d249c34f633dec7b1b7028f52dca050.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_0ce3cd902fe7daf15769c55f9ddbde78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_8a89e1decf0625f3f627814035e527e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_9e70421bf2d24a514d68c2577d1311dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_3cce81d9329f24e9796d1083df05d3e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_2cb7982f50d43f42316751462595e3ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_b06c0e58e406645bcbd09813b522c6ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c01910>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_368c7476e9f86cc4ceaa97684e9ce970.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ac090>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_6882f3a41e19f492da43691924404e54.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea37d0>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_9d35cf918321c6d672acab6a95fa2615.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301af810>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_6d3d0d35e1decb83f1efaa291c52f242.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f85f10>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_b86efeedf096cec0013c8b5412d36b3c.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011f5d0>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_6d249c34f633dec7b1b7028f52dca050.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30075210>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_0ce3cd902fe7daf15769c55f9ddbde78.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011e6d0>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_8a89e1decf0625f3f627814035e527e2.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0983d4a3-c625-5345-8194-0ed25e39a061
2026-04-27 07:59:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0983d4a3-c625-5345-8194-0ed25e39a061, skipping ID generation
2026-04-27 07:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0983d4a3-c625-5345-8194-0ed25e39a061 with scrape type 1
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0983d4a3-c625-5345-8194-0ed25e39a061 sending to next pipeline
2026-04-27 07:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0983d4a3-c625-5345-8194-0ed25e39a061, identifier: NF69216
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30142990>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_9e70421bf2d24a514d68c2577d1311dc.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c210>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_3cce81d9329f24e9796d1083df05d3e1.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf
2026-04-27 07:59:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1604e9b7-f546-5dca-91f4-3b7de42edcdf, skipping ID generation
2026-04-27 07:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf with scrape type 1
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1604e9b7-f546-5dca-91f4-3b7de42edcdf sending to next pipeline
2026-04-27 07:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1604e9b7-f546-5dca-91f4-3b7de42edcdf, identifier: KU34355
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d8790>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_2cb7982f50d43f42316751462595e3ad.jpg saved to cache
2026-04-27 07:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75850>
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_b06c0e58e406645bcbd09813b522c6ea.jpg saved to cache
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 120d019b-1b5a-574d-8e66-7e7830bf3e39
2026-04-27 07:59:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 120d019b-1b5a-574d-8e66-7e7830bf3e39, skipping ID generation
2026-04-27 07:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120d019b-1b5a-574d-8e66-7e7830bf3e39 with scrape type 1
2026-04-27 07:59:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 120d019b-1b5a-574d-8e66-7e7830bf3e39 sending to next pipeline
2026-04-27 07:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 120d019b-1b5a-574d-8e66-7e7830bf3e39, identifier: PB76196
2026-04-27 07:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0983d4a3-c625-5345-8194-0ed25e39a061 with identifier: NF69216
2026-04-27 07:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0983d4a3-c625-5345-8194-0ed25e39a061 with identifier: NF69216
2026-04-27 07:59:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0983d4a3-c625-5345-8194-0ed25e39a061 with identifier: NF69216 to the API
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_8a89e1decf0625f3f627814035e527e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:19:38Z',
 'fuel_type': 'petrol',
 'id': '0983d4a3-c625-5345-8194-0ed25e39a061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF69216',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 215272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_7353f3261e172c959abbd9da1911d52c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_a8ac3d7d508a7098945e2bd3d046dafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_593cf35dccdc1faf1248c0239e526e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_48164995f50d1df5033291a1f6ca2276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_87306a70d234aee454bed744e799cf2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_dedef4d4aa62ff68513d9ef550f527fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_9d35cf918321c6d672acab6a95fa2615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_6d249c34f633dec7b1b7028f52dca050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_8a89e1decf0625f3f627814035e527e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0983d4a3-c625-5345-8194-0ed25e39a061/0983d4a3-c625-5345-8194-0ed25e39a061_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/33/6633f0ec40c9419e8c4afd2c67578486/pa/NF69216_0ce3cd902fe7daf15769c55f9ddbde78.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2007-07-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 200 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-04-27 07:59:39 [auto1.de] INFO: Saving data for NF69216: {'created_time': 1777276779.441831, 'last_price_update_time': 1777276779.441842, 'has_photos': True, 'auction_closing_time': 1777389578.0}
2026-04-27 07:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1604e9b7-f546-5dca-91f4-3b7de42edcdf with identifier: KU34355
2026-04-27 07:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1604e9b7-f546-5dca-91f4-3b7de42edcdf with identifier: KU34355
2026-04-27 07:59:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1604e9b7-f546-5dca-91f4-3b7de42edcdf with identifier: KU34355 to the API
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_3cce81d9329f24e9796d1083df05d3e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Dortmund',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:51:14Z',
 'fuel_type': 'petrol',
 'id': '1604e9b7-f546-5dca-91f4-3b7de42edcdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU34355',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 190036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_b86efeedf096cec0013c8b5412d36b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_3cce81d9329f24e9796d1083df05d3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_6d3d0d35e1decb83f1efaa291c52f242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_368c7476e9f86cc4ceaa97684e9ce970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1604e9b7-f546-5dca-91f4-3b7de42edcdf/1604e9b7-f546-5dca-91f4-3b7de42edcdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/f3/3ef3d2109fda9c1db9b85f40edf44aff/pa/KU34355_4d8d41b9eada7975e087369d9de6bcfc.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2011-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-04-27 07:59:39 [auto1.de] INFO: Saving data for KU34355: {'created_time': 1777276779.76444, 'last_price_update_time': 1777276779.764453, 'has_photos': True, 'auction_closing_time': 1777391474.0}
2026-04-27 07:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 120d019b-1b5a-574d-8e66-7e7830bf3e39 with identifier: PB76196
2026-04-27 07:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 120d019b-1b5a-574d-8e66-7e7830bf3e39 with identifier: PB76196
2026-04-27 07:59:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 120d019b-1b5a-574d-8e66-7e7830bf3e39 with identifier: PB76196 to the API
2026-04-27 07:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_b06c0e58e406645bcbd09813b522c6ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:15:15Z',
 'fuel_type': 'petrol',
 'id': '120d019b-1b5a-574d-8e66-7e7830bf3e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB76196',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 66845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_b06c0e58e406645bcbd09813b522c6ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_2cb7982f50d43f42316751462595e3ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_9e70421bf2d24a514d68c2577d1311dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_6882f3a41e19f492da43691924404e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_84acbbe598360a2cacf28e86d276dfe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_68139450e50adbbd63931c59048e5afe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_4cb9c4ec6fb26dd483a225e7e9817518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_e1b6f914430b236b412d1ba7562ff23a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_a5007ba20b77d9f75cf88fa3759f7cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_120d019b-1b5a-574d-8e66-7e7830bf3e39/120d019b-1b5a-574d-8e66-7e7830bf3e39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/0b/5f0bd70b8f80822ed0a326cdf1f8421f/pa/PB76196_735b70879501e523251b830f844391ce.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2017-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-04-27 07:59:40 [auto1.de] INFO: Saving data for PB76196: {'created_time': 1777276780.150589, 'last_price_update_time': 1777276780.150598, 'has_photos': True, 'auction_closing_time': 1777389315.0}
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_4efc6f84e7b3d600015592af1ec29863.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3b3ddca4d1b70ffe2e3ec63970cacb13.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_7ba6aa18b3d468cff1f911e2c69a537a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3e726d3d828ac8f06802eaee42da4af9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_754fec7d80e7cc8df4cbb3aa28b4496f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_70f681e962046a4b976100103411d969.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d52b90>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_4efc6f84e7b3d600015592af1ec29863.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5110>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3b3ddca4d1b70ffe2e3ec63970cacb13.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9a0d0>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_7ba6aa18b3d468cff1f911e2c69a537a.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159890>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3e726d3d828ac8f06802eaee42da4af9.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5390>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_754fec7d80e7cc8df4cbb3aa28b4496f.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b97050>
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_70f681e962046a4b976100103411d969.jpg saved to cache
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c45cbfce-ad06-5f74-8ffd-d1038acf1479
2026-04-27 07:59:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c45cbfce-ad06-5f74-8ffd-d1038acf1479, skipping ID generation
2026-04-27 07:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45cbfce-ad06-5f74-8ffd-d1038acf1479 with scrape type 1
2026-04-27 07:59:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c45cbfce-ad06-5f74-8ffd-d1038acf1479 sending to next pipeline
2026-04-27 07:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c45cbfce-ad06-5f74-8ffd-d1038acf1479, identifier: CD92686
2026-04-27 07:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c45cbfce-ad06-5f74-8ffd-d1038acf1479 with identifier: CD92686
2026-04-27 07:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c45cbfce-ad06-5f74-8ffd-d1038acf1479 with identifier: CD92686
2026-04-27 07:59:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c45cbfce-ad06-5f74-8ffd-d1038acf1479 with identifier: CD92686 to the API
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_70f681e962046a4b976100103411d969.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Germersheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:59:36Z',
 'fuel_type': 'petrol',
 'id': 'c45cbfce-ad06-5f74-8ffd-d1038acf1479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD92686',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 112851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_7ba6aa18b3d468cff1f911e2c69a537a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_70f681e962046a4b976100103411d969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_754fec7d80e7cc8df4cbb3aa28b4496f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_4efc6f84e7b3d600015592af1ec29863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3b3ddca4d1b70ffe2e3ec63970cacb13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3e726d3d828ac8f06802eaee42da4af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_803f2f1333d2d47ad4ccdb12941d9755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_3136d1ab13199b08fa1cf3a720a1acfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_43b0a8933d3e5b1e8e6e5f62cd58c347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c45cbfce-ad06-5f74-8ffd-d1038acf1479/c45cbfce-ad06-5f74-8ffd-d1038acf1479_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbe0b6e2405457745834eb91ac799e8/pa/CD92686_c40ac07d1e8d0d9baa013b5095629730.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2015-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-04-27 07:59:41 [auto1.de] INFO: Saving data for CD92686: {'created_time': 1777276781.090767, 'last_price_update_time': 1777276781.090778, 'has_photos': True, 'auction_closing_time': 1777391976.0}
2026-04-27 07:59:43 [scrapy.extensions.logstats] INFO: Crawled 382 pages (at 64 pages/min), scraped 162 items (at 35 items/min)
2026-04-27 07:59:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 07:59:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW54595> (referer: https://www.auto1.com/v1/car-details-view/WW54595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with identifier: WW54595
2026-04-27 07:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with scrape type 1
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d3a18e0c5f2ec1bb106988d4b36b869e.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_4d960c9c77270fa9e83a09311c298e2e.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_f2733be6d93f543b1626c62731548d45.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_9a23ddeeb22f5f89f7f1b99d79dfb621.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_067e695c9ddc4fbbfcb4aa018f5e8c98.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d58153a6cf86e1da7dd8221b8c455647.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_50396b6d9ebdf58984d5b7c83c03573e.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_07f8e627c85258cdd19408aab903ebc5.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_c53c903c127a3e581fd7d03a5d0f8afc.jpg not downloaded yet
2026-04-27 07:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_1e123208d5be0c0c0a528bdec7ced2f1.jpg not downloaded yet
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 10587 | hits on page: 40
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: BH77652
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for BH77652: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: ED54075
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for ED54075: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: KU34355
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for KU34355: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: PB76196
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for PB76196: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: PF85631
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for PF85631: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: LS10093
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for LS10093: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: VY08054
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for VY08054: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: RV47209
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for RV47209: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: HT72839
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for HT72839: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: ML65322
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for ML65322: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: FN19474
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for FN19474: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: FE77695
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for FE77695: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: PW12132
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for PW12132: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: EK13927
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for EK13927: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: WP87454
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for WP87454: 0
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: DE49277
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for DE49277: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: TE40935
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for TE40935: 1
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_1e123208d5be0c0c0a528bdec7ced2f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: EK21596
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for EK21596: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: NT88605
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for NT88605: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: EW59776
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for EW59776: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: VB21266
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for VB21266: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: RA50957
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for RA50957: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: JU04536
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for JU04536: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: FU96820
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for FU96820: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: DS38109
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for DS38109: 1
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0c950>
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_1e123208d5be0c0c0a528bdec7ced2f1.jpg saved to cache
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: GA56830
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for GA56830: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: PG24274
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for PG24274: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: LW67845
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for LW67845: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: ZH98222
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for ZH98222: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: BZ42521
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for BZ42521: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: KB53133
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for KB53133: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: CX11621
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for CX11621: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: DW20402
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for DW20402: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: TT05180
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for TT05180: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: NG61507
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for NG61507: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: FD35505
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for FD35505: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: TZ15393
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for TZ15393: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: DV22671
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for DV22671: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: XS85074
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for XS85074: 1
2026-04-27 07:59:47 [auto1.de] INFO: Found listing with ID: ED51719
2026-04-27 07:59:47 [auto1.de] INFO: Scrape type for ED51719: 1
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT57344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS52892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP61181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF16911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ77408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV27190> (referer: https://www.auto1.com/v1/car-details-view/AV27190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ee0fad-a3ac-535f-bc7d-add9a5084742 with identifier: AV27190
2026-04-27 07:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ee0fad-a3ac-535f-bc7d-add9a5084742 with scrape type 1
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_43cf90922e19d2b2d4c9589d2a18ec53.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_cc367a396d46b4e84b51c4cc5ec751a9.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_9270859aa4a849b9cd8315f2c190c6ae.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_f6ba30455d3f2abd1ebe08d5795c4436.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_1a315c526b4deb5960bd675abe2a445e.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_ac6abf33f448c69315348294cf015210.jpg not downloaded yet
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND34621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_ac6abf33f448c69315348294cf015210.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN27958> (referer: https://www.auto1.com/v1/car-details-view/YN27958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7d850>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_ac6abf33f448c69315348294cf015210.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8d30497-85ef-5e93-9eff-62a44d56e209 with identifier: YN27958
2026-04-27 07:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d30497-85ef-5e93-9eff-62a44d56e209 with scrape type 1
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_ba1ef391b0442739cd72a07622de2e2d.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_66ffd934e63b07ae0293866e5a77c53f.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_5042ef8ba70e3be79cf38c076c4e72dd.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_7a8d9b23bd1ce9c4f71102357ae9d080.jpg not downloaded yet
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_6352c24f9f047bdaee80ea6af0d69365.jpg not downloaded yet
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_1a315c526b4deb5960bd675abe2a445e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c2350>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_1a315c526b4deb5960bd675abe2a445e.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_6352c24f9f047bdaee80ea6af0d69365.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300961d0>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_6352c24f9f047bdaee80ea6af0d69365.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_7a8d9b23bd1ce9c4f71102357ae9d080.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_5042ef8ba70e3be79cf38c076c4e72dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62650>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_7a8d9b23bd1ce9c4f71102357ae9d080.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016ff50>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_5042ef8ba70e3be79cf38c076c4e72dd.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_66ffd934e63b07ae0293866e5a77c53f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX15203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_ba1ef391b0442739cd72a07622de2e2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_f6ba30455d3f2abd1ebe08d5795c4436.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c12950>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_66ffd934e63b07ae0293866e5a77c53f.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d91010>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_ba1ef391b0442739cd72a07622de2e2d.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8d30497-85ef-5e93-9eff-62a44d56e209
2026-04-27 07:59:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8d30497-85ef-5e93-9eff-62a44d56e209, skipping ID generation
2026-04-27 07:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d30497-85ef-5e93-9eff-62a44d56e209 with scrape type 1
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8d30497-85ef-5e93-9eff-62a44d56e209 sending to next pipeline
2026-04-27 07:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8d30497-85ef-5e93-9eff-62a44d56e209, identifier: YN27958
2026-04-27 07:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8d30497-85ef-5e93-9eff-62a44d56e209 with identifier: YN27958
2026-04-27 07:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8d30497-85ef-5e93-9eff-62a44d56e209 with identifier: YN27958
2026-04-27 07:59:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8d30497-85ef-5e93-9eff-62a44d56e209 with identifier: YN27958 to the API
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_ba1ef391b0442739cd72a07622de2e2d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'Atting',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:37:16Z',
 'fuel_type': 'diesel',
 'id': 'a8d30497-85ef-5e93-9eff-62a44d56e209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN27958',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 364047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_ba1ef391b0442739cd72a07622de2e2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_66ffd934e63b07ae0293866e5a77c53f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_5042ef8ba70e3be79cf38c076c4e72dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_7a8d9b23bd1ce9c4f71102357ae9d080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a8d30497-85ef-5e93-9eff-62a44d56e209/a8d30497-85ef-5e93-9eff-62a44d56e209_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/a3/0aa333c40ba17091662986020e2b6b97/pa/YN27958_6352c24f9f047bdaee80ea6af0d69365.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2011-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-04-27 07:59:51 [auto1.de] INFO: Saving data for YN27958: {'created_time': 1777276791.201327, 'last_price_update_time': 1777276791.201337, 'has_photos': True, 'auction_closing_time': 1777390636.0}
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_9270859aa4a849b9cd8315f2c190c6ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_cc367a396d46b4e84b51c4cc5ec751a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV72554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW88722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c10190>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_f6ba30455d3f2abd1ebe08d5795c4436.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_43cf90922e19d2b2d4c9589d2a18ec53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e60b90>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_9270859aa4a849b9cd8315f2c190c6ae.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c115d0>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_cc367a396d46b4e84b51c4cc5ec751a9.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b13290>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_43cf90922e19d2b2d4c9589d2a18ec53.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71ee0fad-a3ac-535f-bc7d-add9a5084742
2026-04-27 07:59:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71ee0fad-a3ac-535f-bc7d-add9a5084742, skipping ID generation
2026-04-27 07:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ee0fad-a3ac-535f-bc7d-add9a5084742 with scrape type 1
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71ee0fad-a3ac-535f-bc7d-add9a5084742 sending to next pipeline
2026-04-27 07:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71ee0fad-a3ac-535f-bc7d-add9a5084742, identifier: AV27190
2026-04-27 07:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71ee0fad-a3ac-535f-bc7d-add9a5084742 with identifier: AV27190
2026-04-27 07:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71ee0fad-a3ac-535f-bc7d-add9a5084742 with identifier: AV27190
2026-04-27 07:59:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71ee0fad-a3ac-535f-bc7d-add9a5084742 with identifier: AV27190 to the API
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_43cf90922e19d2b2d4c9589d2a18ec53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'city': 'Kippenheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:22:37Z',
 'fuel_type': 'petrol',
 'id': '71ee0fad-a3ac-535f-bc7d-add9a5084742',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV27190',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 190640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_43cf90922e19d2b2d4c9589d2a18ec53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_cc367a396d46b4e84b51c4cc5ec751a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_9270859aa4a849b9cd8315f2c190c6ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_f6ba30455d3f2abd1ebe08d5795c4436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_1a315c526b4deb5960bd675abe2a445e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_71ee0fad-a3ac-535f-bc7d-add9a5084742/71ee0fad-a3ac-535f-bc7d-add9a5084742_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/c0/95c0e41475c0bd12a321c28e5f2a1a5a/pa/AV27190_ac6abf33f448c69315348294cf015210.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2009-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-04-27 07:59:52 [auto1.de] INFO: Saving data for AV27190: {'created_time': 1777276792.232826, 'last_price_update_time': 1777276792.232836, 'has_photos': True, 'auction_closing_time': 1777389757.0}
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED51719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE49277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP49252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ77408> (referer: https://www.auto1.com/v1/car-details-view/GJ77408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with identifier: GJ77408
2026-04-27 07:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with scrape type 1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_8760dbf85ffdb49b26a1c138e24872e8.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_06bce460521198c203586b6eeb291b8d.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_abf72b3cfec5ef2376a51c5a1f53b6e4.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_b42a15f36290dc9c5c1306f5d9cea6ff.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_e8cd082022941171651e49503dccefe2.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_763ed19aaca3822276f99de3388907cc.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_64ba408311694fd856f7f270ea76e250.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_fe39640b0ca82faf4a98de5b7aa6f901.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_498519bcab25a3012f30cb211e9df6e2.jpg not downloaded yet
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_7294f8efce215a647d0a4e9fab3693f2.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND34621> (referer: https://www.auto1.com/v1/car-details-view/ND34621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-04-27 07:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9861f69c-f16a-51aa-8c37-7979aede0499 with scrape type 1
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_7732cd505510af5dbbc57735178a7692.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_9e67bc44f82b936f1781f0519c0192d3.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_2129a8f86690253dd43f11aaf2b98ed3.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5d29022b0cef4a631884ae964a92df34.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_a1e11bbe203b258bb435ac45869ca0c3.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_7294f8efce215a647d0a4e9fab3693f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_0776254252c26cfe351fb33f12812df1.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_215693bcdb3087a22d1c4e08735305d2.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5cd0b6c990b238847c93d374fbca907d.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_d3ad5cb2b04fe004ec11d769ce8950ae.jpg not downloaded yet
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_c34c480ae004eb7b524a319dd403eef4.jpg not downloaded yet
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_a1e11bbe203b258bb435ac45869ca0c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f31d0>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_7294f8efce215a647d0a4e9fab3693f2.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce8210>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_a1e11bbe203b258bb435ac45869ca0c3.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_c34c480ae004eb7b524a319dd403eef4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30286f90>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_c34c480ae004eb7b524a319dd403eef4.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_d3ad5cb2b04fe004ec11d769ce8950ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5cd0b6c990b238847c93d374fbca907d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159a90>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_d3ad5cb2b04fe004ec11d769ce8950ae.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30287d90>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5cd0b6c990b238847c93d374fbca907d.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_215693bcdb3087a22d1c4e08735305d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300415d0>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_215693bcdb3087a22d1c4e08735305d2.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_0776254252c26cfe351fb33f12812df1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5d29022b0cef4a631884ae964a92df34.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d89d0>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_0776254252c26cfe351fb33f12812df1.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30050b50>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5d29022b0cef4a631884ae964a92df34.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_2129a8f86690253dd43f11aaf2b98ed3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_9e67bc44f82b936f1781f0519c0192d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30096f50>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_2129a8f86690253dd43f11aaf2b98ed3.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_7732cd505510af5dbbc57735178a7692.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fd7990>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_9e67bc44f82b936f1781f0519c0192d3.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV22671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e26b10>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_7732cd505510af5dbbc57735178a7692.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9861f69c-f16a-51aa-8c37-7979aede0499
2026-04-27 07:59:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9861f69c-f16a-51aa-8c37-7979aede0499, skipping ID generation
2026-04-27 07:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9861f69c-f16a-51aa-8c37-7979aede0499 with scrape type 1
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9861f69c-f16a-51aa-8c37-7979aede0499 sending to next pipeline
2026-04-27 07:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9861f69c-f16a-51aa-8c37-7979aede0499, identifier: ND34621
2026-04-27 07:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-04-27 07:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-04-27 07:59:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621 to the API
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_7732cd505510af5dbbc57735178a7692.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'city': 'Zülpich',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:50:49Z',
 'fuel_type': 'diesel',
 'id': '9861f69c-f16a-51aa-8c37-7979aede0499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND34621',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'BMW',
 'model': '3er',
 'odometer': 115963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_7732cd505510af5dbbc57735178a7692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_9e67bc44f82b936f1781f0519c0192d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_2129a8f86690253dd43f11aaf2b98ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5d29022b0cef4a631884ae964a92df34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_a1e11bbe203b258bb435ac45869ca0c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_0776254252c26cfe351fb33f12812df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_215693bcdb3087a22d1c4e08735305d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_5cd0b6c990b238847c93d374fbca907d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_d3ad5cb2b04fe004ec11d769ce8950ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9861f69c-f16a-51aa-8c37-7979aede0499/9861f69c-f16a-51aa-8c37-7979aede0499_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/16/0216e3b43e10a8e96648cd06bc0af5ac/pa/ND34621_c34c480ae004eb7b524a319dd403eef4.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2022-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-04-27 08:00:00 [auto1.de] INFO: Saving data for ND34621: {'created_time': 1777276800.053204, 'last_price_update_time': 1777276800.053217, 'has_photos': True, 'auction_closing_time': 1777391449.0}
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_498519bcab25a3012f30cb211e9df6e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_fe39640b0ca82faf4a98de5b7aa6f901.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX15203> (referer: https://www.auto1.com/v1/car-details-view/ZX15203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS85074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b512d0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_498519bcab25a3012f30cb211e9df6e2.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62e90>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_fe39640b0ca82faf4a98de5b7aa6f901.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc15d797-a143-5a7b-aaca-d48b7d60dae7 with identifier: ZX15203
2026-04-27 08:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc15d797-a143-5a7b-aaca-d48b7d60dae7 with scrape type 1
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_33b9346ae97df500f60834e9d946ffcd.jpg not downloaded yet
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_6088b52e63bf95ec1e1185f3364de941.jpg not downloaded yet
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_a932c1554c8230121264d711d88c9ebe.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_64ba408311694fd856f7f270ea76e250.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_44e296d04112421e89c642d3d29d7df6.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_b42a15f36290dc9c5c1306f5d9cea6ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_763ed19aaca3822276f99de3388907cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_1aaabdcbd384ec11c6279961e2dea43c.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_e8cd082022941171651e49503dccefe2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_413c2cd915015b799055c3974ae73fc3.jpg not downloaded yet
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_a932c1554c8230121264d711d88c9ebe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd40d0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_64ba408311694fd856f7f270ea76e250.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_413c2cd915015b799055c3974ae73fc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b40110>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_b42a15f36290dc9c5c1306f5d9cea6ff.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027b4d0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_763ed19aaca3822276f99de3388907cc.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad390>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_e8cd082022941171651e49503dccefe2.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_44e296d04112421e89c642d3d29d7df6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_1aaabdcbd384ec11c6279961e2dea43c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb0090>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_a932c1554c8230121264d711d88c9ebe.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba79d0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_413c2cd915015b799055c3974ae73fc3.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_33b9346ae97df500f60834e9d946ffcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049510>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_44e296d04112421e89c642d3d29d7df6.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60b50>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_1aaabdcbd384ec11c6279961e2dea43c.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_6088b52e63bf95ec1e1185f3364de941.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5bb10>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_33b9346ae97df500f60834e9d946ffcd.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b43c50>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_6088b52e63bf95ec1e1185f3364de941.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc15d797-a143-5a7b-aaca-d48b7d60dae7
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc15d797-a143-5a7b-aaca-d48b7d60dae7, skipping ID generation
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc15d797-a143-5a7b-aaca-d48b7d60dae7 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc15d797-a143-5a7b-aaca-d48b7d60dae7 sending to next pipeline
2026-04-27 08:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc15d797-a143-5a7b-aaca-d48b7d60dae7, identifier: ZX15203
2026-04-27 08:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc15d797-a143-5a7b-aaca-d48b7d60dae7 with identifier: ZX15203
2026-04-27 08:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc15d797-a143-5a7b-aaca-d48b7d60dae7 with identifier: ZX15203
2026-04-27 08:00:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc15d797-a143-5a7b-aaca-d48b7d60dae7 with identifier: ZX15203 to the API
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_6088b52e63bf95ec1e1185f3364de941.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'city': 'Fockbek',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:10:10Z',
 'fuel_type': 'petrol',
 'id': 'cc15d797-a143-5a7b-aaca-d48b7d60dae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX15203',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 176845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_33b9346ae97df500f60834e9d946ffcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_6088b52e63bf95ec1e1185f3364de941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_a932c1554c8230121264d711d88c9ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_44e296d04112421e89c642d3d29d7df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_1aaabdcbd384ec11c6279961e2dea43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc15d797-a143-5a7b-aaca-d48b7d60dae7/cc15d797-a143-5a7b-aaca-d48b7d60dae7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331e4ac1c7af188aac98739b6bea36d/pa/ZX15203_413c2cd915015b799055c3974ae73fc3.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2009-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.6 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2009}
2026-04-27 08:00:01 [auto1.de] INFO: Saving data for ZX15203: {'created_time': 1777276801.568223, 'last_price_update_time': 1777276801.568234, 'has_photos': True, 'auction_closing_time': 1777389010.0}
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_abf72b3cfec5ef2376a51c5a1f53b6e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_06bce460521198c203586b6eeb291b8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT57344> (referer: https://www.auto1.com/v1/car-details-view/LT57344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_8760dbf85ffdb49b26a1c138e24872e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b1d0>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_abf72b3cfec5ef2376a51c5a1f53b6e4.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b10b90>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_06bce460521198c203586b6eeb291b8d.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bbc336-dfcb-55ef-826c-711f517ef380 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg not downloaded yet
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcd890>
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_8760dbf85ffdb49b26a1c138e24872e8.jpg saved to cache
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1
2026-04-27 08:00:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c515bd5e-8f77-5520-ad84-3c8c78dc17e1, skipping ID generation
2026-04-27 08:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with scrape type 1
2026-04-27 08:00:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c515bd5e-8f77-5520-ad84-3c8c78dc17e1 sending to next pipeline
2026-04-27 08:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c515bd5e-8f77-5520-ad84-3c8c78dc17e1, identifier: GJ77408
2026-04-27 08:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with identifier: GJ77408
2026-04-27 08:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with identifier: GJ77408
2026-04-27 08:00:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c515bd5e-8f77-5520-ad84-3c8c78dc17e1 with identifier: GJ77408 to the API
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_8760dbf85ffdb49b26a1c138e24872e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'city': 'Schkopau',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:39:22Z',
 'fuel_type': 'petrol',
 'id': 'c515bd5e-8f77-5520-ad84-3c8c78dc17e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ77408',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 99217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_8760dbf85ffdb49b26a1c138e24872e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_06bce460521198c203586b6eeb291b8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_abf72b3cfec5ef2376a51c5a1f53b6e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_b42a15f36290dc9c5c1306f5d9cea6ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_e8cd082022941171651e49503dccefe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_763ed19aaca3822276f99de3388907cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_64ba408311694fd856f7f270ea76e250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_fe39640b0ca82faf4a98de5b7aa6f901.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_498519bcab25a3012f30cb211e9df6e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c515bd5e-8f77-5520-ad84-3c8c78dc17e1/c515bd5e-8f77-5520-ad84-3c8c78dc17e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/91/a4915cb09c682309d81afabf4ee5eb91/pa/GJ77408_7294f8efce215a647d0a4e9fab3693f2.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Active Outdoor',
 'transmission': 'manual',
 'trim': 'Active Outdoor',
 'year': 2015}
2026-04-27 08:00:03 [auto1.de] INFO: Saving data for GJ77408: {'created_time': 1777276803.291941, 'last_price_update_time': 1777276803.291951, 'has_photos': True, 'auction_closing_time': 1777390762.0}
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg not downloaded yet
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS52892> (referer: https://www.auto1.com/v1/car-details-view/MS52892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP61181> (referer: https://www.auto1.com/v1/car-details-view/SP61181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg not downloaded yet
2026-04-27 08:00:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg not downloaded yet
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d55f82-3944-5c6d-8b01-50f6bc8054db with identifier: MS52892
2026-04-27 08:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d55f82-3944-5c6d-8b01-50f6bc8054db with scrape type 1
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_534b36706f08891968b6a1232cf8ad0e.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-04-27 08:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with scrape type 1
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_cafcd5e99fba455e70b446b0f95f6439.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_287ee12b3031fa14339b846ebb11c5f1.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_fd335b85ffc602d079cd300893db304d.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_a354b8302296cd2827ccc91f5fcc1b90.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_a561059ce5bf6d45c61df0f39a6f8dde.jpg not downloaded yet
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7e90>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a810>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_66696f478752b153170a3199254d9981.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_7d341d337e40fa24538e224de4f966e6.jpg not downloaded yet
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_60b87da3a8b90a78a0d3dd461ce57b54.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_52dd43f6497f9cf19658285cc9259653.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_af3e9c65df3459e20f9e03be7c4bed3f.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_63c497fa62f57fa87a3642e0dde67e70.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_42183860378f00fa0df1c1eb5d5e2ded.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_264b09afc3102c38fbb4d29f1958a8ba.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_734de95ac2c3de2a700be2967661745a.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6c0418118b5bca24fbad7769ca78bbcd.jpg not downloaded yet
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67310>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_089368e5589b6234d661094e74fe293b.jpg not downloaded yet
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_69a9973600e134cf821a99b77a00b160.jpg not downloaded yet
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7df90>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_a561059ce5bf6d45c61df0f39a6f8dde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_a354b8302296cd2827ccc91f5fcc1b90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_2ff847196aafaf138f429623568a58ac.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6e1905ce28032d390e396aec0977321b.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_089368e5589b6234d661094e74fe293b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e7ee10>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_a561059ce5bf6d45c61df0f39a6f8dde.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0fe90>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_a354b8302296cd2827ccc91f5fcc1b90.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3250>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_089368e5589b6234d661094e74fe293b.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_69a9973600e134cf821a99b77a00b160.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6e1905ce28032d390e396aec0977321b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0dbd0>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_69a9973600e134cf821a99b77a00b160.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3b90>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6e1905ce28032d390e396aec0977321b.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_2ff847196aafaf138f429623568a58ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6c0418118b5bca24fbad7769ca78bbcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE49277> (referer: https://www.auto1.com/v1/car-details-view/DE49277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efb850>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_2ff847196aafaf138f429623568a58ac.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ15393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042710>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6c0418118b5bca24fbad7769ca78bbcd.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with identifier: DE49277
2026-04-27 08:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with scrape type 1
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_92893d79e444d66666d5be1c881519ad.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_264b09afc3102c38fbb4d29f1958a8ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_734de95ac2c3de2a700be2967661745a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e50cb6e89e32820464896e35857b7e13.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e0396f273c74b2d93f0c52bd7b0bbbec.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC21553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_42183860378f00fa0df1c1eb5d5e2ded.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e99aa44e99f9cc4c60289003efead02d.jpg not downloaded yet
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED51719> (referer: https://www.auto1.com/v1/car-details-view/ED51719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF16911> (referer: https://www.auto1.com/v1/car-details-view/DF16911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_78aec160813e7f8f3544c045eca2808b.jpg not downloaded yet
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4ff90>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_264b09afc3102c38fbb4d29f1958a8ba.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1c50>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_734de95ac2c3de2a700be2967661745a.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_3f019201cc0616a2c0556db426b7021a.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_63c497fa62f57fa87a3642e0dde67e70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e0396f273c74b2d93f0c52bd7b0bbbec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e50cb6e89e32820464896e35857b7e13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_af3e9c65df3459e20f9e03be7c4bed3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_5d384e6f0dc4228cf27aa16d5292daa0.jpg not downloaded yet
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35ed0>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_42183860378f00fa0df1c1eb5d5e2ded.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5d19be5-c928-59e6-92d4-de59c6a46448 with identifier: ED51719
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d19be5-c928-59e6-92d4-de59c6a46448 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_8140f25ee9cc74c0d1c3ad77d070223b.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0db33fc-1192-571c-a623-629297914cf8 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_4b2aef9abe6119980b0976f1637520b9.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e99aa44e99f9cc4c60289003efead02d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_20632f79afc9b7f2c0533276d47d3dbe.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_130ae2b1a58d886e24c98a893dcd62a8.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_5551ec6a0bd91f17057e0d38b73f2135.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM33158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43b10>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_63c497fa62f57fa87a3642e0dde67e70.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4edd0>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e0396f273c74b2d93f0c52bd7b0bbbec.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91290>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e50cb6e89e32820464896e35857b7e13.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee38d0>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_af3e9c65df3459e20f9e03be7c4bed3f.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_10c13c77c0d977a2faec526c8c1f9c49.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_d7fed5cca5b803332e41f80e1c684b12.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_90e3f3061ea00adab341839b32ea100f.jpg not downloaded yet
2026-04-27 08:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_60b87da3a8b90a78a0d3dd461ce57b54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_52dd43f6497f9cf19658285cc9259653.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_3f019201cc0616a2c0556db426b7021a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_78aec160813e7f8f3544c045eca2808b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_eefc6a9a36984d61ccd7ff3c34b1eb0b.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_1eabc9e50e5a13e7f653843c9a82c1e3.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_ff1404a509debe98c00d9868a9dbd65a.jpg not downloaded yet
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd2790>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e99aa44e99f9cc4c60289003efead02d.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_e6116055f6186d12c8c7a65fd1b2b5ea.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_f6fa30e7e8c6f76b5daade1e511d50b8.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_4b2aef9abe6119980b0976f1637520b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_5551ec6a0bd91f17057e0d38b73f2135.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30141950>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_60b87da3a8b90a78a0d3dd461ce57b54.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa4b50>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_52dd43f6497f9cf19658285cc9259653.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab18d0>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_3f019201cc0616a2c0556db426b7021a.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa5610>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_78aec160813e7f8f3544c045eca2808b.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_dd956b580ac3fa735e899386be07d227.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_30d218c39c53ef87b9de42b061d8a893.jpg not downloaded yet
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_130ae2b1a58d886e24c98a893dcd62a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_10c13c77c0d977a2faec526c8c1f9c49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_d7fed5cca5b803332e41f80e1c684b12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_90e3f3061ea00adab341839b32ea100f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_77874027ea5991815660578a4dba6f7d.jpg not downloaded yet
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_38f6fbc05d10f61f88dadf9a964fc96a.jpg not downloaded yet
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db7bd0>
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_4b2aef9abe6119980b0976f1637520b9.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a79e50>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_5551ec6a0bd91f17057e0d38b73f2135.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_9138aba6f7787ca4277441d9157f3c99.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_867fe63e65e45f63d9d0b74c3c1bfa13.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9bdd0>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_130ae2b1a58d886e24c98a893dcd62a8.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc7290>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_10c13c77c0d977a2faec526c8c1f9c49.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db4a10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_d7fed5cca5b803332e41f80e1c684b12.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c20e10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_90e3f3061ea00adab341839b32ea100f.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_6b736840e543cedc3729965ceee4ed34.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_bb4de684aa008e65b55c7eab55306bd4.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_1eabc9e50e5a13e7f653843c9a82c1e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_f6fa30e7e8c6f76b5daade1e511d50b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_ff1404a509debe98c00d9868a9dbd65a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_e6116055f6186d12c8c7a65fd1b2b5ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_30d218c39c53ef87b9de42b061d8a893.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_bca1e0735645eac42a8622257ed565b0.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_3e91f8813c23ba8c583e08a5864bac24.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW88722> (referer: https://www.auto1.com/v1/car-details-view/AW88722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_92893d79e444d66666d5be1c881519ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee3010>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_1eabc9e50e5a13e7f653843c9a82c1e3.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_9138aba6f7787ca4277441d9157f3c99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_77874027ea5991815660578a4dba6f7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_6b736840e543cedc3729965ceee4ed34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_bb4de684aa008e65b55c7eab55306bd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV22671> (referer: https://www.auto1.com/v1/car-details-view/DV22671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7a710>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_f6fa30e7e8c6f76b5daade1e511d50b8.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd4690>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_ff1404a509debe98c00d9868a9dbd65a.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f0710>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_e6116055f6186d12c8c7a65fd1b2b5ea.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c18c10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_30d218c39c53ef87b9de42b061d8a893.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db856033-7507-5080-8c54-52e42804df02 with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_867fe63e65e45f63d9d0b74c3c1bfa13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_38f6fbc05d10f61f88dadf9a964fc96a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_3e91f8813c23ba8c583e08a5864bac24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300503d0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_92893d79e444d66666d5be1c881519ad.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b41d50>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_9138aba6f7787ca4277441d9157f3c99.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8a4d0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_77874027ea5991815660578a4dba6f7d.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab1ed0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_6b736840e543cedc3729965ceee4ed34.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a896d0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_bb4de684aa008e65b55c7eab55306bd4.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bf95fba-cebc-58f3-999c-bda3107872ea with identifier: DV22671
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bf95fba-cebc-58f3-999c-bda3107872ea with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_100871a3fec7be00fee91afa8f13edea.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_eefc6a9a36984d61ccd7ff3c34b1eb0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_bca1e0735645eac42a8622257ed565b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_20632f79afc9b7f2c0533276d47d3dbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_dd956b580ac3fa735e899386be07d227.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_4574a35940d8b4f89f875f43af376917.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD35505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_8140f25ee9cc74c0d1c3ad77d070223b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg not downloaded yet
2026-04-27 08:00:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302ab310>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_867fe63e65e45f63d9d0b74c3c1bfa13.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb6550>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_38f6fbc05d10f61f88dadf9a964fc96a.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b40990>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_3e91f8813c23ba8c583e08a5864bac24.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0db33fc-1192-571c-a623-629297914cf8
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0db33fc-1192-571c-a623-629297914cf8, skipping ID generation
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0db33fc-1192-571c-a623-629297914cf8 with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0db33fc-1192-571c-a623-629297914cf8 sending to next pipeline
2026-04-27 08:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0db33fc-1192-571c-a623-629297914cf8, identifier: DF16911
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_34e59d011eb82daf29a0a4e29619fb68.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-04-27 08:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-04-27 08:00:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911 to the API
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_3e91f8813c23ba8c583e08a5864bac24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Kerpen',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:58:01Z',
 'fuel_type': 'petrol',
 'id': 'c0db33fc-1192-571c-a623-629297914cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF16911',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 159093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_4b2aef9abe6119980b0976f1637520b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_5551ec6a0bd91f17057e0d38b73f2135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_90e3f3061ea00adab341839b32ea100f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_ff1404a509debe98c00d9868a9dbd65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_f6fa30e7e8c6f76b5daade1e511d50b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_30d218c39c53ef87b9de42b061d8a893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_38f6fbc05d10f61f88dadf9a964fc96a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_867fe63e65e45f63d9d0b74c3c1bfa13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_bb4de684aa008e65b55c7eab55306bd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0db33fc-1192-571c-a623-629297914cf8/c0db33fc-1192-571c-a623-629297914cf8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/76/90769a88501e8675036e2a3a0697d5bf/pa/DF16911_3e91f8813c23ba8c583e08a5864bac24.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2007-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-04-27 08:00:08 [auto1.de] INFO: Saving data for DF16911: {'created_time': 1777276808.562208, 'last_price_update_time': 1777276808.562221, 'has_photos': True, 'auction_closing_time': 1777391881.0}
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg not downloaded yet
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_7d341d337e40fa24538e224de4f966e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_5d384e6f0dc4228cf27aa16d5292daa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3f9406b0ffe1e212fa3cac9e3e0983f5.jpg not downloaded yet
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f434d0>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_eefc6a9a36984d61ccd7ff3c34b1eb0b.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d82310>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_bca1e0735645eac42a8622257ed565b0.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f363d0>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_20632f79afc9b7f2c0533276d47d3dbe.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22adb010>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_dd956b580ac3fa735e899386be07d227.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b95f50>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_8140f25ee9cc74c0d1c3ad77d070223b.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5d19be5-c928-59e6-92d4-de59c6a46448
2026-04-27 08:00:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5d19be5-c928-59e6-92d4-de59c6a46448, skipping ID generation
2026-04-27 08:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d19be5-c928-59e6-92d4-de59c6a46448 with scrape type 1
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5d19be5-c928-59e6-92d4-de59c6a46448 sending to next pipeline
2026-04-27 08:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5d19be5-c928-59e6-92d4-de59c6a46448, identifier: ED51719
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg not downloaded yet
2026-04-27 08:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5d19be5-c928-59e6-92d4-de59c6a46448 with identifier: ED51719
2026-04-27 08:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5d19be5-c928-59e6-92d4-de59c6a46448 with identifier: ED51719
2026-04-27 08:00:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5d19be5-c928-59e6-92d4-de59c6a46448 with identifier: ED51719 to the API
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_8140f25ee9cc74c0d1c3ad77d070223b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'engine_horse_power': 450,
 'expiration_date': '2026-04-28T15:36:35Z',
 'fuel_type': 'petrol',
 'id': 'a5d19be5-c928-59e6-92d4-de59c6a46448',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED51719',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'BMW',
 'model': '6er',
 'odometer': 276764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_8140f25ee9cc74c0d1c3ad77d070223b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_130ae2b1a58d886e24c98a893dcd62a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_d7fed5cca5b803332e41f80e1c684b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_1eabc9e50e5a13e7f653843c9a82c1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_e6116055f6186d12c8c7a65fd1b2b5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_dd956b580ac3fa735e899386be07d227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_77874027ea5991815660578a4dba6f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_9138aba6f7787ca4277441d9157f3c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_6b736840e543cedc3729965ceee4ed34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a5d19be5-c928-59e6-92d4-de59c6a46448/a5d19be5-c928-59e6-92d4-de59c6a46448_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/86/f28603daa0db21797279d55efa57ce04/pa/ED51719_bca1e0735645eac42a8622257ed565b0.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2016-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6er 650i Gran Coupé xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-04-27 08:00:09 [auto1.de] INFO: Saving data for ED51719: {'created_time': 1777276809.394477, 'last_price_update_time': 1777276809.394487, 'has_photos': True, 'auction_closing_time': 1777390595.0}
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_66696f478752b153170a3199254d9981.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_100871a3fec7be00fee91afa8f13edea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_fe1d1e84287abeb3dc7c51cf10d0fc99.jpg not downloaded yet
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_287ee12b3031fa14339b846ebb11c5f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_fd335b85ffc602d079cd300893db304d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg not downloaded yet
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG61507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f7a910>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_7d341d337e40fa24538e224de4f966e6.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f590d0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_5d384e6f0dc4228cf27aa16d5292daa0.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d
2026-04-27 08:00:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d, skipping ID generation
2026-04-27 08:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with scrape type 1
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28412fa2-f85b-5ba5-8483-66db9d5a2e8d sending to next pipeline
2026-04-27 08:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d, identifier: DE49277
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_48f653de627e758fb349021aa706394e.jpg not downloaded yet
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with identifier: DE49277
2026-04-27 08:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with identifier: DE49277
2026-04-27 08:00:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28412fa2-f85b-5ba5-8483-66db9d5a2e8d with identifier: DE49277 to the API
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_5d384e6f0dc4228cf27aa16d5292daa0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Magdeburg',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:01:24Z',
 'fuel_type': 'diesel',
 'id': '28412fa2-f85b-5ba5-8483-66db9d5a2e8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.082,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE49277',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'location_confidence': 'geocoded',
 'longitude': 11.586,
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 92598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_92893d79e444d66666d5be1c881519ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e50cb6e89e32820464896e35857b7e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e0396f273c74b2d93f0c52bd7b0bbbec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_e99aa44e99f9cc4c60289003efead02d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_78aec160813e7f8f3544c045eca2808b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_3f019201cc0616a2c0556db426b7021a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_5d384e6f0dc4228cf27aa16d5292daa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_20632f79afc9b7f2c0533276d47d3dbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_10c13c77c0d977a2faec526c8c1f9c49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_28412fa2-f85b-5ba5-8483-66db9d5a2e8d/28412fa2-f85b-5ba5-8483-66db9d5a2e8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/88/5f88fd9b099e5397cd95024521771824/pa/DE49277_eefc6a9a36984d61ccd7ff3c34b1eb0b.jpg',
             'Width': 800}],
 'postal_code': '39014',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-04-27 08:00:10 [auto1.de] INFO: Saving data for DE49277: {'created_time': 1777276810.107015, 'last_price_update_time': 1777276810.107027, 'has_photos': True, 'auction_closing_time': 1777388484.0}
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff3550>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a55290>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_34e59d011eb82daf29a0a4e29619fb68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3f9406b0ffe1e212fa3cac9e3e0983f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_4574a35940d8b4f89f875f43af376917.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_46fd33abd6995501a498b6d853592b0a.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP49252> (referer: https://www.auto1.com/v1/car-details-view/KP49252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM33158> (referer: https://www.auto1.com/v1/car-details-view/YM33158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b38690>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_66696f478752b153170a3199254d9981.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a827d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_100871a3fec7be00fee91afa8f13edea.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017acd0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_287ee12b3031fa14339b846ebb11c5f1.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a82f10>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_fd335b85ffc602d079cd300893db304d.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_fe1d1e84287abeb3dc7c51cf10d0fc99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3ba9acbcdf0a8f8771d6d79ec00f99ab.jpg not downloaded yet
2026-04-27 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV72554> (referer: https://www.auto1.com/v1/car-details-view/XV72554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eacc90>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_34e59d011eb82daf29a0a4e29619fb68.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df2650>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c86710>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3f9406b0ffe1e212fa3cac9e3e0983f5.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df0fd0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_4574a35940d8b4f89f875f43af376917.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15a10>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_9f5d1e36e4b775edacc1668ee6b90f83.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_1b083669578d78c0fb5fe64f3e084ae5.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_f2b7a0ec03baa4abf3b407534fbcdc40.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_48f653de627e758fb349021aa706394e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_cafcd5e99fba455e70b446b0f95f6439.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_6b2887cd5847fb10a9f56a5083445cce.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_6af8548a8a0d657d875b9b09e8c1ad8f.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS85074> (referer: https://www.auto1.com/v1/car-details-view/XS85074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_534b36706f08891968b6a1232cf8ad0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_b5991a5a79da5b14669db66df8c409f0.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC21553> (referer: https://www.auto1.com/v1/car-details-view/FC21553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_3f131f7f44a7d029b0cdcf58b08837f6.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_7dbb0eaad58dcc900d433a5f794c173e.jpg not downloaded yet
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f58190>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_fe1d1e84287abeb3dc7c51cf10d0fc99.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6c950>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_46fd33abd6995501a498b6d853592b0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_75b2e9a3f285966976659a44d88651ce.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2b102cefad5243d084ee3b62028af4f9.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg not downloaded yet
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a03a50>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_1b083669578d78c0fb5fe64f3e084ae5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_9f5d1e36e4b775edacc1668ee6b90f83.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_f2b7a0ec03baa4abf3b407534fbcdc40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_d3c775f46b76f2d1aca8bce3ba788b71.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_706dd7adc4e677d512b826330efeae79.jpg not downloaded yet
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg not downloaded yet
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db4090>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_48f653de627e758fb349021aa706394e.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302ab890>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b798d0>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_cafcd5e99fba455e70b446b0f95f6439.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e, skipping ID generation
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e sending to next pipeline
2026-04-27 08:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e, identifier: SP61181
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e970eeb9-47f2-5dff-ad7d-de97bedf39ea with identifier: XS85074
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_cebde1425660772181a1ce849c5cbd05.jpg not downloaded yet
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007bbd0>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_534b36706f08891968b6a1232cf8ad0e.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7d55f82-3944-5c6d-8b01-50f6bc8054db
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7d55f82-3944-5c6d-8b01-50f6bc8054db, skipping ID generation
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d55f82-3944-5c6d-8b01-50f6bc8054db with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7d55f82-3944-5c6d-8b01-50f6bc8054db sending to next pipeline
2026-04-27 08:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7d55f82-3944-5c6d-8b01-50f6bc8054db, identifier: MS52892
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30281790>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e75190>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg not downloaded yet
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cee50>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_6b2887cd5847fb10a9f56a5083445cce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3ba9acbcdf0a8f8771d6d79ec00f99ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-04-27 08:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-04-27 08:00:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181 to the API
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_cafcd5e99fba455e70b446b0f95f6439.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Zülpich',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:02:51Z',
 'fuel_type': 'petrol',
 'id': 'f8c20637-56ae-5ad1-ac6b-b8cd76300d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP61181',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 162964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_cafcd5e99fba455e70b446b0f95f6439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_fd335b85ffc602d079cd300893db304d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_a561059ce5bf6d45c61df0f39a6f8dde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_7d341d337e40fa24538e224de4f966e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_52dd43f6497f9cf19658285cc9259653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_63c497fa62f57fa87a3642e0dde67e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_264b09afc3102c38fbb4d29f1958a8ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6c0418118b5bca24fbad7769ca78bbcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_69a9973600e134cf821a99b77a00b160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8c20637-56ae-5ad1-ac6b-b8cd76300d6e/f8c20637-56ae-5ad1-ac6b-b8cd76300d6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24561d7fd27f71fe4fe3946fc4fa9174/pa/SP61181_6e1905ce28032d390e396aec0977321b.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2010-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-04-27 08:00:12 [auto1.de] INFO: Saving data for SP61181: {'created_time': 1777276812.442066, 'last_price_update_time': 1777276812.442077, 'has_photos': True, 'auction_closing_time': 1777388571.0}
2026-04-27 08:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7d55f82-3944-5c6d-8b01-50f6bc8054db with identifier: MS52892
2026-04-27 08:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7d55f82-3944-5c6d-8b01-50f6bc8054db with identifier: MS52892
2026-04-27 08:00:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7d55f82-3944-5c6d-8b01-50f6bc8054db with identifier: MS52892 to the API
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_534b36706f08891968b6a1232cf8ad0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'city': 'Überherrn',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:41:11Z',
 'fuel_type': 'petrol',
 'id': 'e7d55f82-3944-5c6d-8b01-50f6bc8054db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS52892',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 68295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_534b36706f08891968b6a1232cf8ad0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_287ee12b3031fa14339b846ebb11c5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_a354b8302296cd2827ccc91f5fcc1b90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_66696f478752b153170a3199254d9981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_60b87da3a8b90a78a0d3dd461ce57b54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_af3e9c65df3459e20f9e03be7c4bed3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_42183860378f00fa0df1c1eb5d5e2ded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_734de95ac2c3de2a700be2967661745a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_089368e5589b6234d661094e74fe293b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e7d55f82-3944-5c6d-8b01-50f6bc8054db/e7d55f82-3944-5c6d-8b01-50f6bc8054db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/dd/67dd02ff0ea7ac6f18027df0cd95159f/pa/MS52892_2ff847196aafaf138f429623568a58ac.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2015-11-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-04-27 08:00:12 [auto1.de] INFO: Saving data for MS52892: {'created_time': 1777276812.843625, 'last_price_update_time': 1777276812.843636, 'has_photos': True, 'auction_closing_time': 1777390871.0}
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_6af8548a8a0d657d875b9b09e8c1ad8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_699b964b20fde3f10f504f9fef160e13.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_34c3e3fcec98486fad93a45e48050c15.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1f8ff87c2282140b9c46c7c333e413ff.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg not downloaded yet
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_7dbb0eaad58dcc900d433a5f794c173e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ15393> (referer: https://www.auto1.com/v1/car-details-view/TZ15393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302a8550>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_46fd33abd6995501a498b6d853592b0a.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f789d0>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ddad0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_1b083669578d78c0fb5fe64f3e084ae5.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fd5bd0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_9f5d1e36e4b775edacc1668ee6b90f83.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dc550>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026d950>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_f2b7a0ec03baa4abf3b407534fbcdc40.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_741053acaffca5029dbf2fe0ed84708c.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2ba008bb7b28af3f74329323dc51e99c.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_8704cfc4e24d5a968bf51962ce450570.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg not downloaded yet
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_b5991a5a79da5b14669db66df8c409f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb7e10>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_6b2887cd5847fb10a9f56a5083445cce.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bdf090>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bde2d0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3ba9acbcdf0a8f8771d6d79ec00f99ab.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae7f10>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_3f131f7f44a7d029b0cdcf58b08837f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_2d889b66ccda853cf8556ad3731c17c1.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_67e0291f398c986a4dfd4ec00953341a.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_d78c4fbe46fd6176c581d5bddb5a7b78.jpg not downloaded yet
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg not downloaded yet
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b77dd0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8bbc336-dfcb-55ef-826c-711f517ef380
2026-04-27 08:00:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8bbc336-dfcb-55ef-826c-711f517ef380, skipping ID generation
2026-04-27 08:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bbc336-dfcb-55ef-826c-711f517ef380 with scrape type 1
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8bbc336-dfcb-55ef-826c-711f517ef380 sending to next pipeline
2026-04-27 08:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bbc336-dfcb-55ef-826c-711f517ef380, identifier: LT57344
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015bc10>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_6af8548a8a0d657d875b9b09e8c1ad8f.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ad050>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f080d0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_7dbb0eaad58dcc900d433a5f794c173e.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with identifier: TZ15393
2026-04-27 08:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with scrape type 1
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_dfd9b0254394b7a4f66f762b2281c25f.jpg not downloaded yet
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2b102cefad5243d084ee3b62028af4f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_75b2e9a3f285966976659a44d88651ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344
2026-04-27 08:00:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bbc336-dfcb-55ef-826c-711f517ef380 with identifier: LT57344 to the API
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:31:55Z',
 'fuel_type': 'petrol',
 'id': 'b8bbc336-dfcb-55ef-826c-711f517ef380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT57344',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 61052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a43df81c6a2b2d4f822c5f829d1ec214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_491ea7e583e95c36bbaf17c611570769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_81075cb05af9862c2a2d1262f8b140b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_a98ac636977722013acc8f5107eebd10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_16f2433198c2c4e1648613d9f02bb34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_6f196efd5169108bfa4c36901d96a938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_47daa09dfdffe0d389eb37336b3dad88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_62a6aa80e919dd77cd11e18f5ef8e3d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_ea21618a84054f0dc397f117129327d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b8bbc336-dfcb-55ef-826c-711f517ef380/b8bbc336-dfcb-55ef-826c-711f517ef380_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b8/a4b8d212ae61626cf81e002f7f9da805/pa/LT57344_5a7bbd4e235c11839efb906be3872694.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2015-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2015}
2026-04-27 08:00:14 [auto1.de] INFO: Saving data for LT57344: {'created_time': 1777276814.37677, 'last_price_update_time': 1777276814.376778, 'has_photos': True, 'auction_closing_time': 1777390315.0}
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_706dd7adc4e677d512b826330efeae79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_cebde1425660772181a1ce849c5cbd05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_241201ea7061604c70b1d24d9160aa55.jpg not downloaded yet
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_537c9aaf3799667aa9529b343ef8625e.jpg not downloaded yet
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_9326561e590418985bedcfd84f3a55b1.jpg not downloaded yet
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg not downloaded yet
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_fceb74fcf86f8925779a7da82cf0c0c7.jpg not downloaded yet
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3810>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db856033-7507-5080-8c54-52e42804df02
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db856033-7507-5080-8c54-52e42804df02, skipping ID generation
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db856033-7507-5080-8c54-52e42804df02 with scrape type 1
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db856033-7507-5080-8c54-52e42804df02 sending to next pipeline
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db856033-7507-5080-8c54-52e42804df02, identifier: AW88722
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018b010>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_b5991a5a79da5b14669db66df8c409f0.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bf95fba-cebc-58f3-999c-bda3107872ea
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bf95fba-cebc-58f3-999c-bda3107872ea, skipping ID generation
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bf95fba-cebc-58f3-999c-bda3107872ea with scrape type 1
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bf95fba-cebc-58f3-999c-bda3107872ea sending to next pipeline
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bf95fba-cebc-58f3-999c-bda3107872ea, identifier: DV22671
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-04-27 08:00:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722 to the API
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'city': 'Fockbek',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:52:29Z',
 'fuel_type': 'petrol',
 'id': 'db856033-7507-5080-8c54-52e42804df02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW88722',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 36331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-04-27 08:00:15 [auto1.de] INFO: Saving data for AW88722: {'created_time': 1777276815.129264, 'last_price_update_time': 1777276815.129274, 'has_photos': True, 'auction_closing_time': 1777391549.0}
2026-04-27 08:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bf95fba-cebc-58f3-999c-bda3107872ea with identifier: DV22671
2026-04-27 08:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bf95fba-cebc-58f3-999c-bda3107872ea with identifier: DV22671
2026-04-27 08:00:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bf95fba-cebc-58f3-999c-bda3107872ea with identifier: DV22671 to the API
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_b5991a5a79da5b14669db66df8c409f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Seddiner See',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:52:06Z',
 'fuel_type': 'petrol',
 'id': '9bf95fba-cebc-58f3-999c-bda3107872ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV22671',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_100871a3fec7be00fee91afa8f13edea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_4574a35940d8b4f89f875f43af376917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_34e59d011eb82daf29a0a4e29619fb68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3f9406b0ffe1e212fa3cac9e3e0983f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_fe1d1e84287abeb3dc7c51cf10d0fc99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_48f653de627e758fb349021aa706394e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_46fd33abd6995501a498b6d853592b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_3ba9acbcdf0a8f8771d6d79ec00f99ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_f2b7a0ec03baa4abf3b407534fbcdc40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bf95fba-cebc-58f3-999c-bda3107872ea/9bf95fba-cebc-58f3-999c-bda3107872ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/7b/5c7b9e0ac9ed8e64689770a4e95a6450/pa/DV22671_b5991a5a79da5b14669db66df8c409f0.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2020-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-04-27 08:00:15 [auto1.de] INFO: Saving data for DV22671: {'created_time': 1777276815.479373, 'last_price_update_time': 1777276815.479382, 'has_photos': True, 'auction_closing_time': 1777391526.0}
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1f8ff87c2282140b9c46c7c333e413ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_5ed0ff16bd520bddf364e1a54a6794ff.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_4d67992e0cb6c23678a7a9f483687d52.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_e3d4d7ba5311b44aedea7a714f7f1ad9.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0e45772436d5273ddaadc20d634e6533.jpg not downloaded yet
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD35505> (referer: https://www.auto1.com/v1/car-details-view/FD35505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG61507> (referer: https://www.auto1.com/v1/car-details-view/NG61507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302c8c10>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301de250>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_3f131f7f44a7d029b0cdcf58b08837f6.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f296d0>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2b102cefad5243d084ee3b62028af4f9.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dc590>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_75b2e9a3f285966976659a44d88651ce.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f5add0>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_706dd7adc4e677d512b826330efeae79.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dc690>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb2350>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_cebde1425660772181a1ce849c5cbd05.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_dfd9b0254394b7a4f66f762b2281c25f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_8704cfc4e24d5a968bf51962ce450570.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_592c7df4a60cf9c5eb6c11857d4c9750.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_d458f7106ffc96444839e46ef825fd7a.jpg not downloaded yet
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30303b50>
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg saved to cache
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_d78c4fbe46fd6176c581d5bddb5a7b78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_b2c45bc886844b76fc20ac6ec82b49cf.jpg not downloaded yet
2026-04-27 08:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0ba43bfe83ae334baf99a43c94013364.jpg not downloaded yet
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a56e10>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dafe10>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1f8ff87c2282140b9c46c7c333e413ff.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-04-27 08:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cffc09ee-41dd-591c-8406-4c341567bd5b with scrape type 1
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_00df7b8a22c3b0cb7fa69f51e31b9859.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b5f896-8831-582c-98aa-df6e055cd937 with identifier: NG61507
2026-04-27 08:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b5f896-8831-582c-98aa-df6e055cd937 with scrape type 1
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_7bb56bea3f3bbf6e6083163b0725db69.jpg not downloaded yet
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_67e0291f398c986a4dfd4ec00953341a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0e45772436d5273ddaadc20d634e6533.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_fceb74fcf86f8925779a7da82cf0c0c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1378fc1c2672182f03e67a7d49327f59.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_73da8db1459ef8e9f6ef0be33f48dbfb.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_67ea96a11ecf4dedb3dca39a9f1c7d61.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_c8207262f28ded98d1e231742c2b2e2b.jpg not downloaded yet
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291d310>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_dfd9b0254394b7a4f66f762b2281c25f.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e17d10>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159e50>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cd290>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_8704cfc4e24d5a968bf51962ce450570.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_2d889b66ccda853cf8556ad3731c17c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_9326561e590418985bedcfd84f3a55b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a89090>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22df2d10>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_d78c4fbe46fd6176c581d5bddb5a7b78.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_f4d64f7803a18183d70989d53730f3ea.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_98c572825d6dbd2aee6943bd1c3e39ad.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_6cb5beccc3502f31cff26c6409a1e97e.jpg not downloaded yet
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_60077f3b9a02e190ddaecd052812bfbb.jpg not downloaded yet
2026-04-27 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30285950>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_67e0291f398c986a4dfd4ec00953341a.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75490>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0e45772436d5273ddaadc20d634e6533.jpg saved to cache
2026-04-27 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004cf50>
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_fceb74fcf86f8925779a7da82cf0c0c7.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_537c9aaf3799667aa9529b343ef8625e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_d458f7106ffc96444839e46ef825fd7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_2950d69e13bb2d967065c8a5a8045838.jpg not downloaded yet
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_316c614343135f52dfb9112a7c87e522.jpg not downloaded yet
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_64a2d8d2f7143e0b375b767a6ded36de.jpg not downloaded yet
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_7bb56bea3f3bbf6e6083163b0725db69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_00df7b8a22c3b0cb7fa69f51e31b9859.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_e3d4d7ba5311b44aedea7a714f7f1ad9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_5ed0ff16bd520bddf364e1a54a6794ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_4d67992e0cb6c23678a7a9f483687d52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_8d2bedeeedaa3ff1b9e940f108401a27.jpg not downloaded yet
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_cae4539bb425d8283f8db1fbe4229b8c.jpg not downloaded yet
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_5f040a829823741dd1fb3016dc40ae97.jpg not downloaded yet
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015b4d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_2d889b66ccda853cf8556ad3731c17c1.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e31d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-04-27 08:00:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7fa4612-196d-5fd0-8279-b54a17631155, skipping ID generation
2026-04-27 08:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 1
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7fa4612-196d-5fd0-8279-b54a17631155 sending to next pipeline
2026-04-27 08:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7fa4612-196d-5fd0-8279-b54a17631155, identifier: XV72554
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcc0d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_9326561e590418985bedcfd84f3a55b1.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c89d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b758d0>
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg saved to cache
2026-04-27 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-04-27 08:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-04-27 08:00:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554 to the API
2026-04-27 08:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:55:43Z',
 'fuel_type': 'petrol',
 'id': 'a7fa4612-196d-5fd0-8279-b54a17631155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV72554',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 206641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2013-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-04-27 08:00:18 [auto1.de] INFO: Saving data for XV72554: {'created_time': 1777276818.117172, 'last_price_update_time': 1777276818.117183, 'has_photos': True, 'auction_closing_time': 1777391743.0}
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0ba43bfe83ae334baf99a43c94013364.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_9950c7875532bc59f418cb01a1040125.jpg not downloaded yet
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_2df3747ec6338299e5fdd42af23fd20c.jpg not downloaded yet
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_592c7df4a60cf9c5eb6c11857d4c9750.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_b2c45bc886844b76fc20ac6ec82b49cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b74050>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_537c9aaf3799667aa9529b343ef8625e.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc910>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_d458f7106ffc96444839e46ef825fd7a.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30283f50>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_7bb56bea3f3bbf6e6083163b0725db69.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce8fd0>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_00df7b8a22c3b0cb7fa69f51e31b9859.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289250>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_e3d4d7ba5311b44aedea7a714f7f1ad9.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc850>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_5ed0ff16bd520bddf364e1a54a6794ff.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302809d0>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_4d67992e0cb6c23678a7a9f483687d52.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_6cb5beccc3502f31cff26c6409a1e97e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_c8207262f28ded98d1e231742c2b2e2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_60077f3b9a02e190ddaecd052812bfbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_a71697ee46c543594f6bb94f8bd7b654.jpg not downloaded yet
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_1637f4ae5a2de2d1106a5041ca788ebe.jpg not downloaded yet
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb0e50>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0ba43bfe83ae334baf99a43c94013364.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d68890>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_592c7df4a60cf9c5eb6c11857d4c9750.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc3d90>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c00ed0>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_b2c45bc886844b76fc20ac6ec82b49cf.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_2950d69e13bb2d967065c8a5a8045838.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_64a2d8d2f7143e0b375b767a6ded36de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_8d2bedeeedaa3ff1b9e940f108401a27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_98c572825d6dbd2aee6943bd1c3e39ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_5f040a829823741dd1fb3016dc40ae97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_8ca60c78dafeefa892c29a84944056ea.jpg not downloaded yet
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_316c614343135f52dfb9112a7c87e522.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_cae4539bb425d8283f8db1fbe4229b8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026f490>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_6cb5beccc3502f31cff26c6409a1e97e.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8b290>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_c8207262f28ded98d1e231742c2b2e2b.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f76050>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_60077f3b9a02e190ddaecd052812bfbb.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5b490>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_ce5223be7ffd182edd3b7f79a8828fd1.jpg not downloaded yet
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a88c50>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_2950d69e13bb2d967065c8a5a8045838.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3209ba90>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_64a2d8d2f7143e0b375b767a6ded36de.jpg saved to cache
2026-04-27 08:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cec610>
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_8d2bedeeedaa3ff1b9e940f108401a27.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da0990>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_98c572825d6dbd2aee6943bd1c3e39ad.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01950>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_5f040a829823741dd1fb3016dc40ae97.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a12390>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_316c614343135f52dfb9112a7c87e522.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d98590>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_cae4539bb425d8283f8db1fbe4229b8c.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e09710>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_73da8db1459ef8e9f6ef0be33f48dbfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_9950c7875532bc59f418cb01a1040125.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_f4d64f7803a18183d70989d53730f3ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_67ea96a11ecf4dedb3dca39a9f1c7d61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_2df3747ec6338299e5fdd42af23fd20c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_a71697ee46c543594f6bb94f8bd7b654.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_1637f4ae5a2de2d1106a5041ca788ebe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_ce5223be7ffd182edd3b7f79a8828fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da2c50>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_73da8db1459ef8e9f6ef0be33f48dbfb.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_741053acaffca5029dbf2fe0ed84708c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07e50>
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_9950c7875532bc59f418cb01a1040125.jpg saved to cache
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9
2026-04-27 08:00:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9, skipping ID generation
2026-04-27 08:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with scrape type 1
2026-04-27 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 sending to next pipeline
2026-04-27 08:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9, identifier: TZ15393
2026-04-27 08:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with identifier: TZ15393
2026-04-27 08:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with identifier: TZ15393
2026-04-27 08:00:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dce0e7fe-9baf-5ae2-9dd1-184febdacaa9 with identifier: TZ15393 to the API
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_9950c7875532bc59f418cb01a1040125.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'city': 'Germersheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:04:22Z',
 'fuel_type': 'petrol',
 'id': 'dce0e7fe-9baf-5ae2-9dd1-184febdacaa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ15393',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 44977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56295,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_dfd9b0254394b7a4f66f762b2281c25f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50368,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_fceb74fcf86f8925779a7da82cf0c0c7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50453,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0e45772436d5273ddaadc20d634e6533.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37822,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_d458f7106ffc96444839e46ef825fd7a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44538,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_0ba43bfe83ae334baf99a43c94013364.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51027,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_73da8db1459ef8e9f6ef0be33f48dbfb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34843,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_98c572825d6dbd2aee6943bd1c3e39ad.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53381,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_2950d69e13bb2d967065c8a5a8045838.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54480,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_8d2bedeeedaa3ff1b9e940f108401a27.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dce0e7fe-9baf-5ae2-9dd1-184febdacaa9/dce0e7fe-9baf-5ae2-9dd1-184febdacaa9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51525,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/53/ef53aa538d993950fa938d77c3539f73/pa/TZ15393_9950c7875532bc59f418cb01a1040125.jpg',
             'Width': 640}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2021-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-04-27 08:00:20 [auto1.de] INFO: Saving data for TZ15393: {'created_time': 1777276820.2302, 'last_price_update_time': 1777276820.230212, 'has_photos': True, 'auction_closing_time': 1777388662.0}
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_34c3e3fcec98486fad93a45e48050c15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2ba008bb7b28af3f74329323dc51e99c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_d3c775f46b76f2d1aca8bce3ba788b71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1d150>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_f4d64f7803a18183d70989d53730f3ea.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006ca50>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_67ea96a11ecf4dedb3dca39a9f1c7d61.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cffc09ee-41dd-591c-8406-4c341567bd5b
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cffc09ee-41dd-591c-8406-4c341567bd5b, skipping ID generation
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cffc09ee-41dd-591c-8406-4c341567bd5b with scrape type 1
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cffc09ee-41dd-591c-8406-4c341567bd5b sending to next pipeline
2026-04-27 08:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cffc09ee-41dd-591c-8406-4c341567bd5b, identifier: FD35505
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed3410>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_2df3747ec6338299e5fdd42af23fd20c.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c2490>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_a71697ee46c543594f6bb94f8bd7b654.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302a8e50>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827, skipping ID generation
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 1
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 sending to next pipeline
2026-04-27 08:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827, identifier: FC21553
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1dd0>
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_1637f4ae5a2de2d1106a5041ca788ebe.jpg saved to cache
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_8ca60c78dafeefa892c29a84944056ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_699b964b20fde3f10f504f9fef160e13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1378fc1c2672182f03e67a7d49327f59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_241201ea7061604c70b1d24d9160aa55.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-04-27 08:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-04-27 08:00:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505 to the API
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_67ea96a11ecf4dedb3dca39a9f1c7d61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'city': 'Germersheim',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:13:58Z',
 'fuel_type': 'petrol',
 'id': 'cffc09ee-41dd-591c-8406-4c341567bd5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD35505',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 191034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_00df7b8a22c3b0cb7fa69f51e31b9859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_67ea96a11ecf4dedb3dca39a9f1c7d61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_6cb5beccc3502f31cff26c6409a1e97e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_316c614343135f52dfb9112a7c87e522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cffc09ee-41dd-591c-8406-4c341567bd5b/cffc09ee-41dd-591c-8406-4c341567bd5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d48c5ec710b2f77bfc263236e8d9eb8/pa/FD35505_cae4539bb425d8283f8db1fbe4229b8c.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2008-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-04-27 08:00:21 [auto1.de] INFO: Saving data for FD35505: {'created_time': 1777276821.02649, 'last_price_update_time': 1777276821.026501, 'has_photos': True, 'auction_closing_time': 1777389238.0}
2026-04-27 08:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-04-27 08:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-04-27 08:00:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553 to the API
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:34:23Z',
 'fuel_type': 'diesel',
 'id': '4cc0d039-5b42-53e5-b0a9-2ef0d870a827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC21553',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 207486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Kinetic AWD',
 'transmission': 'automatic',
 'trim': 'Kinetic AWD',
 'year': 2016}
2026-04-27 08:00:21 [auto1.de] INFO: Saving data for FC21553: {'created_time': 1777276821.333516, 'last_price_update_time': 1777276821.333526, 'has_photos': True, 'auction_closing_time': 1777390463.0}
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b41410>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_ce5223be7ffd182edd3b7f79a8828fd1.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75550>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_741053acaffca5029dbf2fe0ed84708c.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2e950>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_34c3e3fcec98486fad93a45e48050c15.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecca90>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2ba008bb7b28af3f74329323dc51e99c.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459
2026-04-27 08:00:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459, skipping ID generation
2026-04-27 08:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with scrape type 1
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 sending to next pipeline
2026-04-27 08:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459, identifier: YM33158
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9b590>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_d3c775f46b76f2d1aca8bce3ba788b71.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6c590>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_8ca60c78dafeefa892c29a84944056ea.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5b5f896-8831-582c-98aa-df6e055cd937
2026-04-27 08:00:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5b5f896-8831-582c-98aa-df6e055cd937, skipping ID generation
2026-04-27 08:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b5f896-8831-582c-98aa-df6e055cd937 with scrape type 1
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5b5f896-8831-582c-98aa-df6e055cd937 sending to next pipeline
2026-04-27 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5b5f896-8831-582c-98aa-df6e055cd937, identifier: NG61507
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014c2d0>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_699b964b20fde3f10f504f9fef160e13.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003cfd0>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1378fc1c2672182f03e67a7d49327f59.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea
2026-04-27 08:00:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e970eeb9-47f2-5dff-ad7d-de97bedf39ea, skipping ID generation
2026-04-27 08:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea with scrape type 1
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e970eeb9-47f2-5dff-ad7d-de97bedf39ea sending to next pipeline
2026-04-27 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e970eeb9-47f2-5dff-ad7d-de97bedf39ea, identifier: XS85074
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a10250>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_241201ea7061604c70b1d24d9160aa55.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b
2026-04-27 08:00:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b, skipping ID generation
2026-04-27 08:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with scrape type 1
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b sending to next pipeline
2026-04-27 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b, identifier: KP49252
2026-04-27 08:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-04-27 08:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-04-27 08:00:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158 to the API
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2ba008bb7b28af3f74329323dc51e99c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'city': 'Germersheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:15:16Z',
 'fuel_type': 'diesel',
 'id': '6ef07434-4b66-5b4e-b99a-e0bcfd58a459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM33158',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 30492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_1b083669578d78c0fb5fe64f3e084ae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_6af8548a8a0d657d875b9b09e8c1ad8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_7dbb0eaad58dcc900d433a5f794c173e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2b102cefad5243d084ee3b62028af4f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_706dd7adc4e677d512b826330efeae79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_34c3e3fcec98486fad93a45e48050c15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_2ba008bb7b28af3f74329323dc51e99c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_67e0291f398c986a4dfd4ec00953341a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_537c9aaf3799667aa9529b343ef8625e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ef07434-4b66-5b4e-b99a-e0bcfd58a459/6ef07434-4b66-5b4e-b99a-e0bcfd58a459_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/1f/141fa540be6a0379246cb31f92899e84/pa/YM33158_4d67992e0cb6c23678a7a9f483687d52.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2018-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Trend',
 'transmission': 'manual',
 'trim': '320 L2 Trend',
 'year': 2018}
2026-04-27 08:00:22 [auto1.de] INFO: Saving data for YM33158: {'created_time': 1777276822.747641, 'last_price_update_time': 1777276822.747652, 'has_photos': True, 'auction_closing_time': 1777389316.0}
2026-04-27 08:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5b5f896-8831-582c-98aa-df6e055cd937 with identifier: NG61507
2026-04-27 08:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5b5f896-8831-582c-98aa-df6e055cd937 with identifier: NG61507
2026-04-27 08:00:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5b5f896-8831-582c-98aa-df6e055cd937 with identifier: NG61507 to the API
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_8ca60c78dafeefa892c29a84944056ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Dortmund',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:09:15Z',
 'fuel_type': 'diesel',
 'id': 'c5b5f896-8831-582c-98aa-df6e055cd937',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG61507',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 283513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_7bb56bea3f3bbf6e6083163b0725db69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_c8207262f28ded98d1e231742c2b2e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_60077f3b9a02e190ddaecd052812bfbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_64a2d8d2f7143e0b375b767a6ded36de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_5f040a829823741dd1fb3016dc40ae97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_2df3747ec6338299e5fdd42af23fd20c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_a71697ee46c543594f6bb94f8bd7b654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_1637f4ae5a2de2d1106a5041ca788ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_8ca60c78dafeefa892c29a84944056ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5b5f896-8831-582c-98aa-df6e055cd937/c5b5f896-8831-582c-98aa-df6e055cd937_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/e1/24e199561f285597a042f19d7964b4a7/pa/NG61507_ce5223be7ffd182edd3b7f79a8828fd1.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2012-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Style BlueMotion Tech',
 'year': 2012}
2026-04-27 08:00:23 [auto1.de] INFO: Saving data for NG61507: {'created_time': 1777276823.151531, 'last_price_update_time': 1777276823.151542, 'has_photos': True, 'auction_closing_time': 1777388955.0}
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e970eeb9-47f2-5dff-ad7d-de97bedf39ea with identifier: XS85074
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e970eeb9-47f2-5dff-ad7d-de97bedf39ea with identifier: XS85074
2026-04-27 08:00:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e970eeb9-47f2-5dff-ad7d-de97bedf39ea with identifier: XS85074 to the API
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1378fc1c2672182f03e67a7d49327f59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Karlskron',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:17:41Z',
 'fuel_type': 'diesel',
 'id': 'e970eeb9-47f2-5dff-ad7d-de97bedf39ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS85074',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 156830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_cebde1425660772181a1ce849c5cbd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1f8ff87c2282140b9c46c7c333e413ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_8704cfc4e24d5a968bf51962ce450570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_d78c4fbe46fd6176c581d5bddb5a7b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_9326561e590418985bedcfd84f3a55b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_e3d4d7ba5311b44aedea7a714f7f1ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_592c7df4a60cf9c5eb6c11857d4c9750.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_b2c45bc886844b76fc20ac6ec82b49cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_1378fc1c2672182f03e67a7d49327f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e970eeb9-47f2-5dff-ad7d-de97bedf39ea/e970eeb9-47f2-5dff-ad7d-de97bedf39ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/de/00de39337c8b9780c861a6a9f1f2acd8/pa/XS85074_f4d64f7803a18183d70989d53730f3ea.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2016-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI ultra',
 'transmission': 'automatic',
 'trim': 'ultra',
 'year': 2016}
2026-04-27 08:00:23 [auto1.de] INFO: Saving data for XS85074: {'created_time': 1777276823.523808, 'last_price_update_time': 1777276823.523818, 'has_photos': True, 'auction_closing_time': 1777389461.0}
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-04-27 08:00:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252 to the API
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_241201ea7061604c70b1d24d9160aa55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:06:22Z',
 'fuel_type': 'petrol',
 'id': '4ad2b0e1-1b20-5329-86d9-e6c84edb084b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP49252',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 146552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_9f5d1e36e4b775edacc1668ee6b90f83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_6b2887cd5847fb10a9f56a5083445cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_3f131f7f44a7d029b0cdcf58b08837f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_75b2e9a3f285966976659a44d88651ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_d3c775f46b76f2d1aca8bce3ba788b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_699b964b20fde3f10f504f9fef160e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_741053acaffca5029dbf2fe0ed84708c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_2d889b66ccda853cf8556ad3731c17c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_241201ea7061604c70b1d24d9160aa55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ad2b0e1-1b20-5329-86d9-e6c84edb084b/4ad2b0e1-1b20-5329-86d9-e6c84edb084b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/0d/1c0d3d90429b8625fa5c6eda9034853d/pa/KP49252_5ed0ff16bd520bddf364e1a54a6794ff.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2015-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI X-Perience 4Drive',
 'transmission': 'automatic',
 'trim': 'X-Perience 4Drive',
 'year': 2015}
2026-04-27 08:00:23 [auto1.de] INFO: Saving data for KP49252: {'created_time': 1777276823.883587, 'last_price_update_time': 1777276823.883599, 'has_photos': True, 'auction_closing_time': 1777388782.0}
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW20402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW67845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA56830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS38109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU96820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG24274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT05180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL82940> (referer: https://www.auto1.com/v1/car-details-view/WL82940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b68e14-3241-5198-a188-ffc248212c48 with identifier: WL82940
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b68e14-3241-5198-a188-ffc248212c48 with scrape type 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_a80a4ef1dc9c324840b39b65750b1e79.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_261a842cd55e59fa4763ef4340b840f1.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_30da75cdab879edb58df9b4d331fbbfb.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_ba58cd59dcde3e2714e26909e303d7b8.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_abff838556a88da0286873d0cd37ceb8.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_67167d8b352b44a4e631472a2cd971d2.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_3a28dd4c4e5c37ce195d7ba1cbfb857b.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_46c864984a1d61ce27ec5545747a0803.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_01e60b241fa03e9257d29d9099281ca4.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_64736c945c7fe21289f4893e1095d5c1.jpg not downloaded yet
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB21266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_64736c945c7fe21289f4893e1095d5c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eebed0>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_64736c945c7fe21289f4893e1095d5c1.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU04536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_01e60b241fa03e9257d29d9099281ca4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1d310>
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_01e60b241fa03e9257d29d9099281ca4.jpg saved to cache
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX11621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_46c864984a1d61ce27ec5545747a0803.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2d8d0>
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_46c864984a1d61ce27ec5545747a0803.jpg saved to cache
2026-04-27 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW59776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_3a28dd4c4e5c37ce195d7ba1cbfb857b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300395d0>
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_3a28dd4c4e5c37ce195d7ba1cbfb857b.jpg saved to cache
2026-04-27 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW20402> (referer: https://www.auto1.com/v1/car-details-view/DW20402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_67167d8b352b44a4e631472a2cd971d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with identifier: DW20402
2026-04-27 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with scrape type 1
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_c1bbb49d7f1f2fad1c8418c71889f97f.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_40b4280577dbbf93be4a898821a90ad5.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_7a91705ac995fc9ea04ea57c5bf6c6c1.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_df14eebff1c7e34d391c57a6f851b851.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_5acf6ef805c6fbb1fa0bc4e4aa1434f1.jpg not downloaded yet
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2c250>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_67167d8b352b44a4e631472a2cd971d2.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_e8b4f43752ece0f845853fd570381ddf.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_4f2ec3e96b848b9e7eb3ef21b0c0ba00.jpg not downloaded yet
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_abff838556a88da0286873d0cd37ceb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_8b12f32d953ac56e6a5ee41be77768bc.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_012995496c4eeb9cf37089d86c8e9d69.jpg not downloaded yet
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_ae4a30c1bc5f6e9181f49c066667fac8.jpg not downloaded yet
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcd650>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_abff838556a88da0286873d0cd37ceb8.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_4f2ec3e96b848b9e7eb3ef21b0c0ba00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a70910>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_4f2ec3e96b848b9e7eb3ef21b0c0ba00.jpg saved to cache
2026-04-27 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_ae4a30c1bc5f6e9181f49c066667fac8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2fe50>
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_ae4a30c1bc5f6e9181f49c066667fac8.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_012995496c4eeb9cf37089d86c8e9d69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_8b12f32d953ac56e6a5ee41be77768bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d79610>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_012995496c4eeb9cf37089d86c8e9d69.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82ad0>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_8b12f32d953ac56e6a5ee41be77768bc.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_e8b4f43752ece0f845853fd570381ddf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_5acf6ef805c6fbb1fa0bc4e4aa1434f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd6e10>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_e8b4f43752ece0f845853fd570381ddf.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2e510>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_5acf6ef805c6fbb1fa0bc4e4aa1434f1.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_df14eebff1c7e34d391c57a6f851b851.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30279e90>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_df14eebff1c7e34d391c57a6f851b851.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_7a91705ac995fc9ea04ea57c5bf6c6c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcf750>
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_7a91705ac995fc9ea04ea57c5bf6c6c1.jpg saved to cache
2026-04-27 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_40b4280577dbbf93be4a898821a90ad5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_c1bbb49d7f1f2fad1c8418c71889f97f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a72b50>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_40b4280577dbbf93be4a898821a90ad5.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcf450>
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_c1bbb49d7f1f2fad1c8418c71889f97f.jpg saved to cache
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586
2026-04-27 08:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c1a65f2-2e75-595b-83d1-4ec7dd587586, skipping ID generation
2026-04-27 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with scrape type 1
2026-04-27 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c1a65f2-2e75-595b-83d1-4ec7dd587586 sending to next pipeline
2026-04-27 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c1a65f2-2e75-595b-83d1-4ec7dd587586, identifier: DW20402
2026-04-27 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with identifier: DW20402
2026-04-27 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with identifier: DW20402
2026-04-27 08:00:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c1a65f2-2e75-595b-83d1-4ec7dd587586 with identifier: DW20402 to the API
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_c1bbb49d7f1f2fad1c8418c71889f97f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'city': 'Kippenheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '7c1a65f2-2e75-595b-83d1-4ec7dd587586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW20402',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'Volkswagen',
 'model': 'Golf VI Plus',
 'odometer': 85484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_c1bbb49d7f1f2fad1c8418c71889f97f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_40b4280577dbbf93be4a898821a90ad5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_7a91705ac995fc9ea04ea57c5bf6c6c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_df14eebff1c7e34d391c57a6f851b851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_5acf6ef805c6fbb1fa0bc4e4aa1434f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_e8b4f43752ece0f845853fd570381ddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_4f2ec3e96b848b9e7eb3ef21b0c0ba00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_8b12f32d953ac56e6a5ee41be77768bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_012995496c4eeb9cf37089d86c8e9d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c1a65f2-2e75-595b-83d1-4ec7dd587586/7c1a65f2-2e75-595b-83d1-4ec7dd587586_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/849189e5577ac6f6ee67245faec946fc/pa/DW20402_ae4a30c1bc5f6e9181f49c066667fac8.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2010-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI Plus 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-04-27 08:00:40 [auto1.de] INFO: Saving data for DW20402: {'created_time': 1777276840.886285, 'last_price_update_time': 1777276840.886294, 'has_photos': True, 'auction_closing_time': 1777389474.0}
2026-04-27 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_ba58cd59dcde3e2714e26909e303d7b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300dba50>
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_ba58cd59dcde3e2714e26909e303d7b8.jpg saved to cache
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_30da75cdab879edb58df9b4d331fbbfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd0f50>
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_30da75cdab879edb58df9b4d331fbbfb.jpg saved to cache
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_261a842cd55e59fa4763ef4340b840f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2dc50>
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_261a842cd55e59fa4763ef4340b840f1.jpg saved to cache
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_a80a4ef1dc9c324840b39b65750b1e79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7b650>
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_a80a4ef1dc9c324840b39b65750b1e79.jpg saved to cache
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48b68e14-3241-5198-a188-ffc248212c48
2026-04-27 08:00:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48b68e14-3241-5198-a188-ffc248212c48, skipping ID generation
2026-04-27 08:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b68e14-3241-5198-a188-ffc248212c48 with scrape type 1
2026-04-27 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48b68e14-3241-5198-a188-ffc248212c48 sending to next pipeline
2026-04-27 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48b68e14-3241-5198-a188-ffc248212c48, identifier: WL82940
2026-04-27 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48b68e14-3241-5198-a188-ffc248212c48 with identifier: WL82940
2026-04-27 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48b68e14-3241-5198-a188-ffc248212c48 with identifier: WL82940
2026-04-27 08:00:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48b68e14-3241-5198-a188-ffc248212c48 with identifier: WL82940 to the API
2026-04-27 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_a80a4ef1dc9c324840b39b65750b1e79.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Kaiserslautern',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:37:05Z',
 'fuel_type': 'petrol',
 'id': '48b68e14-3241-5198-a188-ffc248212c48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.45,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL82940',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'location_confidence': 'geocoded',
 'longitude': 7.75,
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 107821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_a80a4ef1dc9c324840b39b65750b1e79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_261a842cd55e59fa4763ef4340b840f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_30da75cdab879edb58df9b4d331fbbfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_ba58cd59dcde3e2714e26909e303d7b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_abff838556a88da0286873d0cd37ceb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_67167d8b352b44a4e631472a2cd971d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_3a28dd4c4e5c37ce195d7ba1cbfb857b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3141246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_46c864984a1d61ce27ec5545747a0803.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_01e60b241fa03e9257d29d9099281ca4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_48b68e14-3241-5198-a188-ffc248212c48/48b68e14-3241-5198-a188-ffc248212c48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e4/aae43f560ea1df195deefd5c846794da/pa/WL82940_64736c945c7fe21289f4893e1095d5c1.jpg',
             'Width': 2048}],
 'postal_code': '67653',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2018-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Ambiance',
 'transmission': 'manual',
 'trim': 'Stepway Ambiance',
 'year': 2018}
2026-04-27 08:00:42 [auto1.de] INFO: Saving data for WL82940: {'created_time': 1777276842.162131, 'last_price_update_time': 1777276842.162142, 'has_photos': True, 'auction_closing_time': 1777390625.0}
2026-04-27 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW67845> (referer: https://www.auto1.com/v1/car-details-view/LW67845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5efdc9f-7da3-5404-bdee-d8a9363a17bd with identifier: LW67845
2026-04-27 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd with scrape type 1
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_53559340da389f22b56b35330a27374e.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_8b418fb6f1c1c0948a3e29d739e95833.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_675c63b89073abd82a752e184a0f67b5.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_08adb00f652bc0704583cdf06025e8c9.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_cbb4be8b64672bfcc2edd14ae08255b0.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_5bbd07e997d21b2a57098ce792de9f9a.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_de372324083b47a305fc5408bce4d958.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_50340ef98dd991ad76ebab3024e794d8.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_44f8c5f92aaf1b52038850119bbf0ea0.jpg not downloaded yet
2026-04-27 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_3f44d1dce628703728ad81280eb5445f.jpg not downloaded yet
2026-04-27 08:00:43 [scrapy.extensions.logstats] INFO: Crawled 438 pages (at 56 pages/min), scraped 185 items (at 23 items/min)
2026-04-27 08:00:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA56830> (referer: https://www.auto1.com/v1/car-details-view/GA56830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT88605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with identifier: GA56830
2026-04-27 08:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with scrape type 1
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_c2905a8ae754611f4dc529da4bdd755c.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f04374a6e5232486841eae4dbb66914d.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f6b6d86396fbb3c072675cf573439ac5.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_03ec398b3489da051904d80d75f7db39.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_caeedbd1924bce95e4d81b4adb2929ef.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_76a24a7369c4f156f3633ea12b9e90a6.jpg not downloaded yet
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_3f44d1dce628703728ad81280eb5445f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_b221f38d02ca7d69b4c6661dec62fb56.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f8b7fbfa4b88db211ff6994c634021d7.jpg not downloaded yet
2026-04-27 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_44f8c5f92aaf1b52038850119bbf0ea0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_d0cfef0c3a583e565f5a04e183f56a38.jpg not downloaded yet
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_81c0f3ec58b881ba8ff458cca1837d80.jpg not downloaded yet
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4fd10>
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_3f44d1dce628703728ad81280eb5445f.jpg saved to cache
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04350>
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_44f8c5f92aaf1b52038850119bbf0ea0.jpg saved to cache
2026-04-27 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_76a24a7369c4f156f3633ea12b9e90a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f8b7fbfa4b88db211ff6994c634021d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9f510>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_76a24a7369c4f156f3633ea12b9e90a6.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e9c8d0>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f8b7fbfa4b88db211ff6994c634021d7.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_81c0f3ec58b881ba8ff458cca1837d80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_d0cfef0c3a583e565f5a04e183f56a38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f5a890>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_81c0f3ec58b881ba8ff458cca1837d80.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a610>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_d0cfef0c3a583e565f5a04e183f56a38.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_b221f38d02ca7d69b4c6661dec62fb56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_caeedbd1924bce95e4d81b4adb2929ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b2ff90>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_b221f38d02ca7d69b4c6661dec62fb56.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eeaa50>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_caeedbd1924bce95e4d81b4adb2929ef.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_03ec398b3489da051904d80d75f7db39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe96d0>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_03ec398b3489da051904d80d75f7db39.jpg saved to cache
2026-04-27 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f6b6d86396fbb3c072675cf573439ac5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1e810>
2026-04-27 08:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f6b6d86396fbb3c072675cf573439ac5.jpg saved to cache
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f04374a6e5232486841eae4dbb66914d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_c2905a8ae754611f4dc529da4bdd755c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcc250>
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f04374a6e5232486841eae4dbb66914d.jpg saved to cache
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018bd10>
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_c2905a8ae754611f4dc529da4bdd755c.jpg saved to cache
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327
2026-04-27 08:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327, skipping ID generation
2026-04-27 08:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with scrape type 1
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 sending to next pipeline
2026-04-27 08:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327, identifier: GA56830
2026-04-27 08:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with identifier: GA56830
2026-04-27 08:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with identifier: GA56830
2026-04-27 08:00:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea4ed8a-d9ac-5c11-9f77-ddfe2c743327 with identifier: GA56830 to the API
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_c2905a8ae754611f4dc529da4bdd755c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'city': 'Schkopau',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:54:43Z',
 'fuel_type': 'petrol',
 'id': 'bea4ed8a-d9ac-5c11-9f77-ddfe2c743327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA56830',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 40036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_c2905a8ae754611f4dc529da4bdd755c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f04374a6e5232486841eae4dbb66914d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f6b6d86396fbb3c072675cf573439ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_03ec398b3489da051904d80d75f7db39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_caeedbd1924bce95e4d81b4adb2929ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_76a24a7369c4f156f3633ea12b9e90a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_b221f38d02ca7d69b4c6661dec62fb56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_f8b7fbfa4b88db211ff6994c634021d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_d0cfef0c3a583e565f5a04e183f56a38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea4ed8a-d9ac-5c11-9f77-ddfe2c743327/bea4ed8a-d9ac-5c11-9f77-ddfe2c743327_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/35/d335f521e0da513a8747561aeb4aaebd/pa/GA56830_81c0f3ec58b881ba8ff458cca1837d80.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2021-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2021}
2026-04-27 08:00:55 [auto1.de] INFO: Saving data for GA56830: {'created_time': 1777276855.842667, 'last_price_update_time': 1777276855.842676, 'has_photos': True, 'auction_closing_time': 1777391683.0}
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_50340ef98dd991ad76ebab3024e794d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT05180> (referer: https://www.auto1.com/v1/car-details-view/TT05180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG24274> (referer: https://www.auto1.com/v1/car-details-view/PG24274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d79990>
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_50340ef98dd991ad76ebab3024e794d8.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with identifier: TT05180
2026-04-27 08:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with scrape type 1
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_7d6dc031d8a033bf2f9ba2f32d443db5.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-04-27 08:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 1
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_360f19f9f18a64583d16727a08616321.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_4c6c4186fbd9547f6a2958415fe440a0.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_bf794d2de05f44644fb89eb00ddc1bc1.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH98222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_5bbd07e997d21b2a57098ce792de9f9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_de372324083b47a305fc5408bce4d958.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_34010628c0a4e1ac86b903f345523039.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_fd8456352a24720ddf9c0d935baf1701.jpg not downloaded yet
2026-04-27 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_cbb4be8b64672bfcc2edd14ae08255b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_2a2f4ee6926510c50be700777b5ea7df.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_3d9388179f0952d8eeca65c5a3ae76f6.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_f09875ced9bc0b5e171f7b8e6953eff7.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_de71a5b605947e08bca8aaccab399f09.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_97ded8b1d70bbf95b7343c35a1662e15.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_0080e830e896a9bcafbcbd1138260845.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30188bd0>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_5bbd07e997d21b2a57098ce792de9f9a.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f52b50>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_de372324083b47a305fc5408bce4d958.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_360f19f9f18a64583d16727a08616321.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_b3bd3feec1f43be73c48ca36f2cfd429.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_ccfe53014954fd39b3fe2e94e8407b47.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_7d6dc031d8a033bf2f9ba2f32d443db5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_78e3ff9de9fdeb863a97e4ac3ea60385.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_9ed82917183acb8f7bcbf7f3d2fa0075.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_9132f56b5f62439e3a5a49651a457029.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_43ff33200477f8cdd91e6d96b1b09d43.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d98350>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_cbb4be8b64672bfcc2edd14ae08255b0.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_4c6c4186fbd9547f6a2958415fe440a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_454c4c47353170935ca2cc4bb0145090.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_92c2a070cd2ffccf01994e277e223354.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_bf794d2de05f44644fb89eb00ddc1bc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30287910>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_360f19f9f18a64583d16727a08616321.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c35a10>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_7d6dc031d8a033bf2f9ba2f32d443db5.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_0080e830e896a9bcafbcbd1138260845.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d3cd0>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_4c6c4186fbd9547f6a2958415fe440a0.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcc310>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_bf794d2de05f44644fb89eb00ddc1bc1.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_43ff33200477f8cdd91e6d96b1b09d43.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_9132f56b5f62439e3a5a49651a457029.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebb6ad0>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_0080e830e896a9bcafbcbd1138260845.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0ff90>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_43ff33200477f8cdd91e6d96b1b09d43.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_92c2a070cd2ffccf01994e277e223354.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1c690>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_9132f56b5f62439e3a5a49651a457029.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_9ed82917183acb8f7bcbf7f3d2fa0075.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_454c4c47353170935ca2cc4bb0145090.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c22490>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_92c2a070cd2ffccf01994e277e223354.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d1850>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_9ed82917183acb8f7bcbf7f3d2fa0075.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6b8d0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_454c4c47353170935ca2cc4bb0145090.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_ccfe53014954fd39b3fe2e94e8407b47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_78e3ff9de9fdeb863a97e4ac3ea60385.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_b3bd3feec1f43be73c48ca36f2cfd429.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_f09875ced9bc0b5e171f7b8e6953eff7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6ae50>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_ccfe53014954fd39b3fe2e94e8407b47.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecea10>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_78e3ff9de9fdeb863a97e4ac3ea60385.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e92c90>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_b3bd3feec1f43be73c48ca36f2cfd429.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_97ded8b1d70bbf95b7343c35a1662e15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_3d9388179f0952d8eeca65c5a3ae76f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS38109> (referer: https://www.auto1.com/v1/car-details-view/DS38109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dafe90>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_f09875ced9bc0b5e171f7b8e6953eff7.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_de71a5b605947e08bca8aaccab399f09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b432d0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_97ded8b1d70bbf95b7343c35a1662e15.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302998d0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_3d9388179f0952d8eeca65c5a3ae76f6.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b8e106-1df0-5930-93ab-3a34cea4a6ca with identifier: DS38109
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca with scrape type 1
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8be1b181a9cb3f7915e6e7c317d34bc6.jpg not downloaded yet
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae4110>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_de71a5b605947e08bca8aaccab399f09.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_fb9feb6bd812f6683df11e0886fb2f17.jpg not downloaded yet
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_2a2f4ee6926510c50be700777b5ea7df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_34010628c0a4e1ac86b903f345523039.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_fd8456352a24720ddf9c0d935baf1701.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX11621> (referer: https://www.auto1.com/v1/car-details-view/CX11621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_08adb00f652bc0704583cdf06025e8c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_535e57fdce57fcda98d20722f71e03aa.jpg not downloaded yet
2026-04-27 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_58089498fc5392f38012c47861b1c400.jpg not downloaded yet
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ded83f84d5a5da9d72b6b63ebc2566ad.jpg not downloaded yet
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_267b0e424efc40dcc43269c52bdfc9bf.jpg not downloaded yet
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8be1b181a9cb3f7915e6e7c317d34bc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_53559340da389f22b56b35330a27374e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_fb9feb6bd812f6683df11e0886fb2f17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_7f6e364cc0da6e64ec75b4b0bd9acb42.jpg not downloaded yet
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_aaa6c75c4895624446132ce490c55f6a.jpg not downloaded yet
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30287ad0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_2a2f4ee6926510c50be700777b5ea7df.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0f10>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_34010628c0a4e1ac86b903f345523039.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d22555-ee13-5fb0-8e6c-1c9e90f09863, skipping ID generation
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with scrape type 1
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37d22555-ee13-5fb0-8e6c-1c9e90f09863 sending to next pipeline
2026-04-27 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37d22555-ee13-5fb0-8e6c-1c9e90f09863, identifier: TT05180
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30057d90>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_fd8456352a24720ddf9c0d935baf1701.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3a45927-1997-5e4c-af77-e3843bf636a7
2026-04-27 08:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3a45927-1997-5e4c-af77-e3843bf636a7, skipping ID generation
2026-04-27 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 1
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3a45927-1997-5e4c-af77-e3843bf636a7 sending to next pipeline
2026-04-27 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3a45927-1997-5e4c-af77-e3843bf636a7, identifier: PG24274
2026-04-27 08:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d16b835-3975-5c8f-841f-39d75e7f90ab with identifier: CX11621
2026-04-27 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d16b835-3975-5c8f-841f-39d75e7f90ab with scrape type 1
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_7fa1f792374433e7c1ec107dbf08a26c.jpg not downloaded yet
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dacf10>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_08adb00f652bc0704583cdf06025e8c9.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8ee6ab3a610d7acc24d80b033a37959d.jpg not downloaded yet
2026-04-27 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with identifier: TT05180
2026-04-27 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with identifier: TT05180
2026-04-27 08:00:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37d22555-ee13-5fb0-8e6c-1c9e90f09863 with identifier: TT05180 to the API
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_34010628c0a4e1ac86b903f345523039.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Germersheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '37d22555-ee13-5fb0-8e6c-1c9e90f09863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT05180',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 116168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_7d6dc031d8a033bf2f9ba2f32d443db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_4c6c4186fbd9547f6a2958415fe440a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_34010628c0a4e1ac86b903f345523039.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_2a2f4ee6926510c50be700777b5ea7df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_f09875ced9bc0b5e171f7b8e6953eff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_97ded8b1d70bbf95b7343c35a1662e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_b3bd3feec1f43be73c48ca36f2cfd429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_78e3ff9de9fdeb863a97e4ac3ea60385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_9132f56b5f62439e3a5a49651a457029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37d22555-ee13-5fb0-8e6c-1c9e90f09863/37d22555-ee13-5fb0-8e6c-1c9e90f09863_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/15/43159f3a7ccb7556d2a6de813f3a0060/pa/TT05180_454c4c47353170935ca2cc4bb0145090.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2016-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-04-27 08:00:58 [auto1.de] INFO: Saving data for TT05180: {'created_time': 1777276858.861473, 'last_price_update_time': 1777276858.861484, 'has_photos': True, 'auction_closing_time': 1777390883.0}
2026-04-27 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-04-27 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-04-27 08:00:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274 to the API
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_fd8456352a24720ddf9c0d935baf1701.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Lahr',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:58:31Z',
 'fuel_type': 'petrol',
 'id': 'c3a45927-1997-5e4c-af77-e3843bf636a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.9333,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24274',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'location_confidence': 'geocoded',
 'longitude': 6.2833,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_360f19f9f18a64583d16727a08616321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_bf794d2de05f44644fb89eb00ddc1bc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_fd8456352a24720ddf9c0d935baf1701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_3d9388179f0952d8eeca65c5a3ae76f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_de71a5b605947e08bca8aaccab399f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_0080e830e896a9bcafbcbd1138260845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_ccfe53014954fd39b3fe2e94e8407b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_9ed82917183acb8f7bcbf7f3d2fa0075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_43ff33200477f8cdd91e6d96b1b09d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3a45927-1997-5e4c-af77-e3843bf636a7/c3a45927-1997-5e4c-af77-e3843bf636a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/49/d54950512e6974879758b4c48af82194/pa/PG24274_92c2a070cd2ffccf01994e277e223354.jpg',
             'Width': 800}],
 'postal_code': '54675',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2015-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TSI ACT BlueGT',
 'transmission': 'manual',
 'trim': 'BlueGT',
 'year': 2015}
2026-04-27 08:00:59 [auto1.de] INFO: Saving data for PG24274: {'created_time': 1777276859.342472, 'last_price_update_time': 1777276859.342483, 'has_photos': True, 'auction_closing_time': 1777391911.0}
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_58089498fc5392f38012c47861b1c400.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ded83f84d5a5da9d72b6b63ebc2566ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_267b0e424efc40dcc43269c52bdfc9bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_ada586d33be121b8cb8148d158d4ae05.jpg not downloaded yet
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_675c63b89073abd82a752e184a0f67b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_8b418fb6f1c1c0948a3e29d739e95833.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ee2688cce6731bd19be14a9a6ab0e3a5.jpg not downloaded yet
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU04536> (referer: https://www.auto1.com/v1/car-details-view/JU04536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_800ba103f42b89b24fb1f4d2e48fb79d.jpg not downloaded yet
2026-04-27 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0c10>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8be1b181a9cb3f7915e6e7c317d34bc6.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30062750>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_53559340da389f22b56b35330a27374e.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fb2d0>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_fb9feb6bd812f6683df11e0886fb2f17.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e8a3ead8872f34137cc96ae555f49a44.jpg not downloaded yet
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_7fa1f792374433e7c1ec107dbf08a26c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30062c90>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_58089498fc5392f38012c47861b1c400.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fa6d10>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ded83f84d5a5da9d72b6b63ebc2566ad.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291d390>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_267b0e424efc40dcc43269c52bdfc9bf.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a289d0>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_675c63b89073abd82a752e184a0f67b5.jpg saved to cache
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc3d10>
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_8b418fb6f1c1c0948a3e29d739e95833.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd
2026-04-27 08:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5efdc9f-7da3-5404-bdee-d8a9363a17bd, skipping ID generation
2026-04-27 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd with scrape type 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5efdc9f-7da3-5404-bdee-d8a9363a17bd sending to next pipeline
2026-04-27 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5efdc9f-7da3-5404-bdee-d8a9363a17bd, identifier: LW67845
2026-04-27 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-04-27 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with scrape type 1
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_7f6e364cc0da6e64ec75b4b0bd9acb42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_aaa6c75c4895624446132ce490c55f6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8ee6ab3a610d7acc24d80b033a37959d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_24fbee35284c7280d7b04dd63e42b9b5.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5efdc9f-7da3-5404-bdee-d8a9363a17bd with identifier: LW67845
2026-04-27 08:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5efdc9f-7da3-5404-bdee-d8a9363a17bd with identifier: LW67845
2026-04-27 08:01:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5efdc9f-7da3-5404-bdee-d8a9363a17bd with identifier: LW67845 to the API
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_8b418fb6f1c1c0948a3e29d739e95833.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:05:50Z',
 'fuel_type': 'petrol',
 'id': 'f5efdc9f-7da3-5404-bdee-d8a9363a17bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW67845',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 104427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_53559340da389f22b56b35330a27374e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_8b418fb6f1c1c0948a3e29d739e95833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_675c63b89073abd82a752e184a0f67b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_08adb00f652bc0704583cdf06025e8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_cbb4be8b64672bfcc2edd14ae08255b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_5bbd07e997d21b2a57098ce792de9f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_de372324083b47a305fc5408bce4d958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_50340ef98dd991ad76ebab3024e794d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_44f8c5f92aaf1b52038850119bbf0ea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5efdc9f-7da3-5404-bdee-d8a9363a17bd/f5efdc9f-7da3-5404-bdee-d8a9363a17bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9d/bb9d7b0175d332d26c2458af1846feec/pa/LW67845_3f44d1dce628703728ad81280eb5445f.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2014-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.6 T2 You!',
 'transmission': 'manual',
 'trim': 'You!',
 'year': 2014}
2026-04-27 08:01:00 [auto1.de] INFO: Saving data for LW67845: {'created_time': 1777276860.613011, 'last_price_update_time': 1777276860.613024, 'has_photos': True, 'auction_closing_time': 1777388750.0}
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_ada586d33be121b8cb8148d158d4ae05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_535e57fdce57fcda98d20722f71e03aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_eeb342ea6a73f4f5e082b16bd1b0f0a1.jpg not downloaded yet
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d1fd0>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_7fa1f792374433e7c1ec107dbf08a26c.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg not downloaded yet
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_bd99ed3167a320ca3937ec85c918bb4f.jpg not downloaded yet
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a010>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_7f6e364cc0da6e64ec75b4b0bd9acb42.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302815d0>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_aaa6c75c4895624446132ce490c55f6a.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208ab50>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8ee6ab3a610d7acc24d80b033a37959d.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK21596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW59776> (referer: https://www.auto1.com/v1/car-details-view/EW59776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ee2688cce6731bd19be14a9a6ab0e3a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e8a3ead8872f34137cc96ae555f49a44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e98eb510370000d5e3fce14c3a4bbbe2.jpg not downloaded yet
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB21266> (referer: https://www.auto1.com/v1/car-details-view/VB21266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_800ba103f42b89b24fb1f4d2e48fb79d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg not downloaded yet
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30282850>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_ada586d33be121b8cb8148d158d4ae05.jpg saved to cache
2026-04-27 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d680d0>
2026-04-27 08:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_535e57fdce57fcda98d20722f71e03aa.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_c53c903c127a3e581fd7d03a5d0f8afc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_db180312e956199ba964bcd331e0133a.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_c4f4a0bfaa5e7bdd7dc4880172641283.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with identifier: EW59776
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with scrape type 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a62b561256751867918c29f452ddf5e4.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0a350>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ee2688cce6731bd19be14a9a6ab0e3a5.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5b8e106-1df0-5930-93ab-3a34cea4a6ca, skipping ID generation
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca with scrape type 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5b8e106-1df0-5930-93ab-3a34cea4a6ca sending to next pipeline
2026-04-27 08:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5b8e106-1df0-5930-93ab-3a34cea4a6ca, identifier: DS38109
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2c650>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e8a3ead8872f34137cc96ae555f49a44.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-04-27 08:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783a9e0c-800c-56af-b462-b1a90effa43f with scrape type 1
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_80b6b11171862319e14cecc48a7c0a2f.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5b8e106-1df0-5930-93ab-3a34cea4a6ca with identifier: DS38109
2026-04-27 08:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5b8e106-1df0-5930-93ab-3a34cea4a6ca with identifier: DS38109
2026-04-27 08:01:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5b8e106-1df0-5930-93ab-3a34cea4a6ca with identifier: DS38109 to the API
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ee2688cce6731bd19be14a9a6ab0e3a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Ketzin',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-04-28T15:10:58Z',
 'fuel_type': 'diesel',
 'id': 'e5b8e106-1df0-5930-93ab-3a34cea4a6ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS38109',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 101010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8be1b181a9cb3f7915e6e7c317d34bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_fb9feb6bd812f6683df11e0886fb2f17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_535e57fdce57fcda98d20722f71e03aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_58089498fc5392f38012c47861b1c400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ded83f84d5a5da9d72b6b63ebc2566ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_267b0e424efc40dcc43269c52bdfc9bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_7f6e364cc0da6e64ec75b4b0bd9acb42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_aaa6c75c4895624446132ce490c55f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_8ee6ab3a610d7acc24d80b033a37959d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e5b8e106-1df0-5930-93ab-3a34cea4a6ca/e5b8e106-1df0-5930-93ab-3a34cea4a6ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a5ef4a5faccf0f0c4cdcb4f711bc6/pa/DS38109_ee2688cce6731bd19be14a9a6ab0e3a5.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2018-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Bi-Turbo ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-04-27 08:01:01 [auto1.de] INFO: Saving data for DS38109: {'created_time': 1777276861.747508, 'last_price_update_time': 1777276861.74752, 'has_photos': True, 'auction_closing_time': 1777389058.0}
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_18ca2b50e079766a69594fa7dfb5ec02.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_3d7e5282f663057a3f3544afcd243bc9.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026dd50>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce8050>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_800ba103f42b89b24fb1f4d2e48fb79d.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_07f8e627c85258cdd19408aab903ebc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e98eb510370000d5e3fce14c3a4bbbe2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_bd99ed3167a320ca3937ec85c918bb4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_24fbee35284c7280d7b04dd63e42b9b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_eeb342ea6a73f4f5e082b16bd1b0f0a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_e2d37a107a0f5332a8f9de8de016f3b7.jpg not downloaded yet
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_7c62ef13a98c87d822396b7212c3ab0d.jpg not downloaded yet
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e92850>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_c53c903c127a3e581fd7d03a5d0f8afc.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg not downloaded yet
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a28410>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_705920cc7ac986c2bb9bbd14a8ab03b0.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2e9af29431d602866006898d8b2f4487.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU96820> (referer: https://www.auto1.com/v1/car-details-view/FU96820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a29fd0>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1f2d0>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_07f8e627c85258cdd19408aab903ebc5.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62b50>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b419d0>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e98eb510370000d5e3fce14c3a4bbbe2.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65910>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_bd99ed3167a320ca3937ec85c918bb4f.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b02950>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_24fbee35284c7280d7b04dd63e42b9b5.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b02d10>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_eeb342ea6a73f4f5e082b16bd1b0f0a1.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a62b561256751867918c29f452ddf5e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_16e66cedbd5ffe64182b71cb3b02559d.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c0de38cd9a4347f0c00376047923f0ac.jpg not downloaded yet
2026-04-27 08:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_80b6b11171862319e14cecc48a7c0a2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_c4f4a0bfaa5e7bdd7dc4880172641283.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_db180312e956199ba964bcd331e0133a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_742a4dac33df41dc90ffc0193421ea87.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_a6c035db0835bc71833f53836f0863f1.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6946bb-d59a-5168-9661-98fadc9586b8 with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c5610612e6e89a31c5b3a711adbc013b.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_20078efa32c8946897160bf79ccee5b1.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_d20d63c41817c5299fc526e3e6384c88.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_9af7d13249b1f8f7b368f419f6962592.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_7417e41b32ad6e95c1def9d8a3bf94a5.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_97cdc0a5b136a7573e4bb50394fe1c02.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_d01ac022133bc425ff44ae1df5ac9950.jpg not downloaded yet
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c610>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a62b561256751867918c29f452ddf5e4.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cef110>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2e9af29431d602866006898d8b2f4487.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_705920cc7ac986c2bb9bbd14a8ab03b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_e2d37a107a0f5332a8f9de8de016f3b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_16e66cedbd5ffe64182b71cb3b02559d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a1463f5811d44cb3350d2f11fb35f472.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2f8aed6695295c11be82b62b47f07a84.jpg not downloaded yet
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_f6c4f17f85ffdaee3f30506bcf7fa0fa.jpg not downloaded yet
2026-04-27 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c0de38cd9a4347f0c00376047923f0ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6a090>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3c50>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4efd0>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_80b6b11171862319e14cecc48a7c0a2f.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301945d0>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_c4f4a0bfaa5e7bdd7dc4880172641283.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b4f610>
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_db180312e956199ba964bcd331e0133a.jpg saved to cache
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d16b835-3975-5c8f-841f-39d75e7f90ab
2026-04-27 08:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d16b835-3975-5c8f-841f-39d75e7f90ab, skipping ID generation
2026-04-27 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d16b835-3975-5c8f-841f-39d75e7f90ab with scrape type 1
2026-04-27 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d16b835-3975-5c8f-841f-39d75e7f90ab sending to next pipeline
2026-04-27 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d16b835-3975-5c8f-841f-39d75e7f90ab, identifier: CX11621
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4cc90>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_7c62ef13a98c87d822396b7212c3ab0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_d691920cf2828ac65617b6525e2efcdf.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c633a9c9cb500198bed6cb1a24e57ded.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1e4244b0d713d8209063e6dfea5d5d79.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d16b835-3975-5c8f-841f-39d75e7f90ab with identifier: CX11621
2026-04-27 08:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d16b835-3975-5c8f-841f-39d75e7f90ab with identifier: CX11621
2026-04-27 08:01:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d16b835-3975-5c8f-841f-39d75e7f90ab with identifier: CX11621 to the API
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_db180312e956199ba964bcd331e0133a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'city': 'Seddiner See',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:59:01Z',
 'fuel_type': 'diesel',
 'id': '7d16b835-3975-5c8f-841f-39d75e7f90ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX11621',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 191614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_7fa1f792374433e7c1ec107dbf08a26c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_ada586d33be121b8cb8148d158d4ae05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_800ba103f42b89b24fb1f4d2e48fb79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e8a3ead8872f34137cc96ae555f49a44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_24fbee35284c7280d7b04dd63e42b9b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_eeb342ea6a73f4f5e082b16bd1b0f0a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_bd99ed3167a320ca3937ec85c918bb4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_e98eb510370000d5e3fce14c3a4bbbe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_db180312e956199ba964bcd331e0133a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d16b835-3975-5c8f-841f-39d75e7f90ab/7d16b835-3975-5c8f-841f-39d75e7f90ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/4a/774a2e7e9ef80c688ee57fded2726f68/pa/CX11621_c4f4a0bfaa5e7bdd7dc4880172641283.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2014-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'automatic',
 'trim': 'Center-Line 2WD',
 'year': 2014}
2026-04-27 08:01:03 [auto1.de] INFO: Saving data for CX11621: {'created_time': 1777276863.571651, 'last_price_update_time': 1777276863.57166, 'has_photos': True, 'auction_closing_time': 1777391941.0}
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_9af7d13249b1f8f7b368f419f6962592.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_17a299bfad967fe8cc61b10f578efc54.jpg not downloaded yet
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5d650>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b877d0>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2e9af29431d602866006898d8b2f4487.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f74350>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_705920cc7ac986c2bb9bbd14a8ab03b0.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027b410>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_e2d37a107a0f5332a8f9de8de016f3b7.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b86210>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_16e66cedbd5ffe64182b71cb3b02559d.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae6f90>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c0de38cd9a4347f0c00376047923f0ac.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3b10>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_7c62ef13a98c87d822396b7212c3ab0d.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_d20d63c41817c5299fc526e3e6384c88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_20078efa32c8946897160bf79ccee5b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c3740937ccbefd996631d011f759aa9c.jpg not downloaded yet
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c5610612e6e89a31c5b3a711adbc013b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_7417e41b32ad6e95c1def9d8a3bf94a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_d01ac022133bc425ff44ae1df5ac9950.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_f6c4f17f85ffdaee3f30506bcf7fa0fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_97cdc0a5b136a7573e4bb50394fe1c02.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee6310>
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_9af7d13249b1f8f7b368f419f6962592.jpg saved to cache
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1c68fb83fbe901165ded83385beefcc0.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_16ed589e0f1140204aa1f2e5591d35b7.jpg not downloaded yet
2026-04-27 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_a6ae5d4e5ebafb4e3fddfbb8b3a8b2a8.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a1463f5811d44cb3350d2f11fb35f472.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE40935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a82650>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_d20d63c41817c5299fc526e3e6384c88.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c00b10>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_20078efa32c8946897160bf79ccee5b1.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1e4244b0d713d8209063e6dfea5d5d79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35890>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c5610612e6e89a31c5b3a711adbc013b.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f53010>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_7417e41b32ad6e95c1def9d8a3bf94a5.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5410>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_d01ac022133bc425ff44ae1df5ac9950.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f50b90>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_f6c4f17f85ffdaee3f30506bcf7fa0fa.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62e90>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_97cdc0a5b136a7573e4bb50394fe1c02.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2f8aed6695295c11be82b62b47f07a84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_a6c035db0835bc71833f53836f0863f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_d691920cf2828ac65617b6525e2efcdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c633a9c9cb500198bed6cb1a24e57ded.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_742a4dac33df41dc90ffc0193421ea87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_17a299bfad967fe8cc61b10f578efc54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_a6ae5d4e5ebafb4e3fddfbb8b3a8b2a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41a50>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a1463f5811d44cb3350d2f11fb35f472.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK21596> (referer: https://www.auto1.com/v1/car-details-view/EK21596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e20190>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1e4244b0d713d8209063e6dfea5d5d79.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d99810>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2f8aed6695295c11be82b62b47f07a84.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_18ca2b50e079766a69594fa7dfb5ec02.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e75a10>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_a6c035db0835bc71833f53836f0863f1.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c02490>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_d691920cf2828ac65617b6525e2efcdf.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3390>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c633a9c9cb500198bed6cb1a24e57ded.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300547d0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_742a4dac33df41dc90ffc0193421ea87.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed38d0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_17a299bfad967fe8cc61b10f578efc54.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a294d0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_a6ae5d4e5ebafb4e3fddfbb8b3a8b2a8.jpg saved to cache
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_50396b6d9ebdf58984d5b7c83c03573e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-04-27 08:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 1
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg not downloaded yet
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_16ed589e0f1140204aa1f2e5591d35b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c3740937ccbefd996631d011f759aa9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d58153a6cf86e1da7dd8221b8c455647.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1c68fb83fbe901165ded83385beefcc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_3d7e5282f663057a3f3544afcd243bc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg not downloaded yet
2026-04-27 08:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c025d0>
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_18ca2b50e079766a69594fa7dfb5ec02.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a
2026-04-27 08:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a, skipping ID generation
2026-04-27 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with scrape type 1
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a sending to next pipeline
2026-04-27 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a, identifier: EW59776
2026-04-27 08:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with identifier: EW59776
2026-04-27 08:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with identifier: EW59776
2026-04-27 08:01:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 374bcd84-9f60-5354-a6b7-60d1e0d4cf4a with identifier: EW59776 to the API
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_18ca2b50e079766a69594fa7dfb5ec02.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'city': 'Dortmund',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-04-28T15:35:19Z',
 'fuel_type': 'petrol',
 'id': '374bcd84-9f60-5354-a6b7-60d1e0d4cf4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW59776',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 116066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a62b561256751867918c29f452ddf5e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_18ca2b50e079766a69594fa7dfb5ec02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_e2d37a107a0f5332a8f9de8de016f3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_705920cc7ac986c2bb9bbd14a8ab03b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_16e66cedbd5ffe64182b71cb3b02559d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_742a4dac33df41dc90ffc0193421ea87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_20078efa32c8946897160bf79ccee5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_7417e41b32ad6e95c1def9d8a3bf94a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_a1463f5811d44cb3350d2f11fb35f472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_374bcd84-9f60-5354-a6b7-60d1e0d4cf4a/374bcd84-9f60-5354-a6b7-60d1e0d4cf4a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/94/c0944b2c9848a028e5b03cb9fa1f52a1/pa/EW59776_d691920cf2828ac65617b6525e2efcdf.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2016-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2016}
2026-04-27 08:01:05 [auto1.de] INFO: Saving data for EW59776: {'created_time': 1777276865.718456, 'last_price_update_time': 1777276865.718465, 'has_photos': True, 'auction_closing_time': 1777390519.0}
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_9a23ddeeb22f5f89f7f1b99d79dfb621.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg not downloaded yet
2026-04-27 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_067e695c9ddc4fbbfcb4aa018f5e8c98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a00ed0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_50396b6d9ebdf58984d5b7c83c03573e.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301664d0>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_16ed589e0f1140204aa1f2e5591d35b7.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f36f10>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg saved to cache
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-04-27 08:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811, skipping ID generation
2026-04-27 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with scrape type 1
2026-04-27 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 sending to next pipeline
2026-04-27 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811, identifier: JU04536
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5990>
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c3740937ccbefd996631d011f759aa9c.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167410>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d58153a6cf86e1da7dd8221b8c455647.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014ffd0>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1c68fb83fbe901165ded83385beefcc0.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa6946bb-d59a-5168-9661-98fadc9586b8
2026-04-27 08:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa6946bb-d59a-5168-9661-98fadc9586b8, skipping ID generation
2026-04-27 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6946bb-d59a-5168-9661-98fadc9586b8 with scrape type 1
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa6946bb-d59a-5168-9661-98fadc9586b8 sending to next pipeline
2026-04-27 08:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa6946bb-d59a-5168-9661-98fadc9586b8, identifier: FU96820
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f9c10>
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_3d7e5282f663057a3f3544afcd243bc9.jpg saved to cache
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 783a9e0c-800c-56af-b462-b1a90effa43f
2026-04-27 08:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 783a9e0c-800c-56af-b462-b1a90effa43f, skipping ID generation
2026-04-27 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783a9e0c-800c-56af-b462-b1a90effa43f with scrape type 1
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 783a9e0c-800c-56af-b462-b1a90effa43f sending to next pipeline
2026-04-27 08:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 783a9e0c-800c-56af-b462-b1a90effa43f, identifier: VB21266
2026-04-27 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_f2733be6d93f543b1626c62731548d45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg not downloaded yet
2026-04-27 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-04-27 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-04-27 08:01:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536 to the API
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'city': 'Kandel',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-04-28T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '9b58405c-b76d-5ff4-b4c8-8a93a3e69811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04536',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 169534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2011-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.8 TSI Active Plus Edition 4x4',
 'transmission': 'manual',
 'trim': 'Active Plus Edition 4x4',
 'year': 2011}
2026-04-27 08:01:06 [auto1.de] INFO: Saving data for JU04536: {'created_time': 1777276866.709547, 'last_price_update_time': 1777276866.709557, 'has_photos': True, 'auction_closing_time': 1777389474.0}
2026-04-27 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-04-27 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-04-27 08:01:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820 to the API
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1c68fb83fbe901165ded83385beefcc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:13:38Z',
 'fuel_type': 'diesel',
 'id': 'aa6946bb-d59a-5168-9661-98fadc9586b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU96820',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 262949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c5610612e6e89a31c5b3a711adbc013b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_9af7d13249b1f8f7b368f419f6962592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_d01ac022133bc425ff44ae1df5ac9950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_f6c4f17f85ffdaee3f30506bcf7fa0fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1e4244b0d713d8209063e6dfea5d5d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_17a299bfad967fe8cc61b10f578efc54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_c3740937ccbefd996631d011f759aa9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_1c68fb83fbe901165ded83385beefcc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_16ed589e0f1140204aa1f2e5591d35b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6946bb-d59a-5168-9661-98fadc9586b8/aa6946bb-d59a-5168-9661-98fadc9586b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/03/0e0383b836dab2b026b435b5d9a6ee5d/pa/FU96820_a6ae5d4e5ebafb4e3fddfbb8b3a8b2a8.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2016-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-04-27 08:01:07 [auto1.de] INFO: Saving data for FU96820: {'created_time': 1777276867.027583, 'last_price_update_time': 1777276867.027596, 'has_photos': True, 'auction_closing_time': 1777389218.0}
2026-04-27 08:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-04-27 08:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-04-27 08:01:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266 to the API
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_3d7e5282f663057a3f3544afcd243bc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Buch',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:42:33Z',
 'fuel_type': 'petrol',
 'id': '783a9e0c-800c-56af-b462-b1a90effa43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB21266',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 237228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_80b6b11171862319e14cecc48a7c0a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_3d7e5282f663057a3f3544afcd243bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_7c62ef13a98c87d822396b7212c3ab0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2e9af29431d602866006898d8b2f4487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c0de38cd9a4347f0c00376047923f0ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_a6c035db0835bc71833f53836f0863f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_d20d63c41817c5299fc526e3e6384c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_97cdc0a5b136a7573e4bb50394fe1c02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_2f8aed6695295c11be82b62b47f07a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_783a9e0c-800c-56af-b462-b1a90effa43f/783a9e0c-800c-56af-b462-b1a90effa43f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/67/0067b9bf2bfdb393eaa9b0f4cc137bb6/pa/VB21266_c633a9c9cb500198bed6cb1a24e57ded.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-04-27 08:01:07 [auto1.de] INFO: Saving data for VB21266: {'created_time': 1777276867.445966, 'last_price_update_time': 1777276867.445976, 'has_photos': True, 'auction_closing_time': 1777390953.0}
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d3a18e0c5f2ec1bb106988d4b36b869e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_4d960c9c77270fa9e83a09311c298e2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg not downloaded yet
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30061a90>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_9a23ddeeb22f5f89f7f1b99d79dfb621.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b74cd0>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_067e695c9ddc4fbbfcb4aa018f5e8c98.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c08b90>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_f2733be6d93f543b1626c62731548d45.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg not downloaded yet
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0b110>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee3150>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d3a18e0c5f2ec1bb106988d4b36b869e.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026dc50>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_4d960c9c77270fa9e83a09311c298e2e.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4, skipping ID generation
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with scrape type 1
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 sending to next pipeline
2026-04-27 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4, identifier: WW54595
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with identifier: WW54595
2026-04-27 08:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with identifier: WW54595
2026-04-27 08:01:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7247b6f9-e81a-5be0-a820-0ce1bdfec7d4 with identifier: WW54595 to the API
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_4d960c9c77270fa9e83a09311c298e2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'city': 'Erbach',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 117,
 'expiration_date': '2026-04-28T15:16:02Z',
 'fuel_type': 'petrol',
 'id': '7247b6f9-e81a-5be0-a820-0ce1bdfec7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW54595',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 53400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d3a18e0c5f2ec1bb106988d4b36b869e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_4d960c9c77270fa9e83a09311c298e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_f2733be6d93f543b1626c62731548d45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_9a23ddeeb22f5f89f7f1b99d79dfb621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_067e695c9ddc4fbbfcb4aa018f5e8c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_d58153a6cf86e1da7dd8221b8c455647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_50396b6d9ebdf58984d5b7c83c03573e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_07f8e627c85258cdd19408aab903ebc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_c53c903c127a3e581fd7d03a5d0f8afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7247b6f9-e81a-5be0-a820-0ce1bdfec7d4/7247b6f9-e81a-5be0-a820-0ce1bdfec7d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/1b/281b573a7aaf8f08f84691947a15b618/pa/WW54595_1e123208d5be0c0c0a528bdec7ced2f1.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2019-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition+ 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition+ 2WD',
 'year': 2019}
2026-04-27 08:01:08 [auto1.de] INFO: Saving data for WW54595: {'created_time': 1777276868.279556, 'last_price_update_time': 1777276868.279568, 'has_photos': True, 'auction_closing_time': 1777389362.0}
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg not downloaded yet
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053690>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f697d0>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2c810>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE40935> (referer: https://www.auto1.com/v1/car-details-view/TE40935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2f510>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6ecd0>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da3510>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-04-27 08:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with scrape type 1
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg not downloaded yet
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg not downloaded yet
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg not downloaded yet
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg not downloaded yet
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg not downloaded yet
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73f50>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026e850>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg not downloaded yet
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189650>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, skipping ID generation
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 1
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 sending to next pipeline
2026-04-27 08:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, identifier: EK21596
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-04-27 08:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-04-27 08:01:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596 to the API
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Dortmund',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:44:52Z',
 'fuel_type': 'petrol',
 'id': '6b02dc6b-cad8-5579-8b4c-ba44ecac7f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK21596',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 6650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid Homura 2WD',
 'transmission': 'manual',
 'trim': 'Homura 2WD',
 'year': 2022}
2026-04-27 08:01:09 [auto1.de] INFO: Saving data for EK21596: {'created_time': 1777276869.665569, 'last_price_update_time': 1777276869.665583, 'has_photos': True, 'auction_closing_time': 1777391092.0}
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f46d0>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3df90>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07b10>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30288650>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f2c50>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43290>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f69850>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004dc90>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dca490>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301599d0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-04-27 08:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a115b0a9-c4ff-5bd2-bd26-83062c79fc48, skipping ID generation
2026-04-27 08:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with scrape type 1
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 sending to next pipeline
2026-04-27 08:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a115b0a9-c4ff-5bd2-bd26-83062c79fc48, identifier: TE40935
2026-04-27 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-04-27 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-04-27 08:01:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935 to the API
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Germersheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-04-28T15:10:48Z',
 'fuel_type': 'petrol',
 'id': 'a115b0a9-c4ff-5bd2-bd26-83062c79fc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE40935',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2015-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-04-27 08:01:11 [auto1.de] INFO: Saving data for TE40935: {'created_time': 1777276871.247897, 'last_price_update_time': 1777276871.24791, 'has_photos': True, 'auction_closing_time': 1777389048.0}
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH98222> (referer: https://www.auto1.com/v1/car-details-view/ZH98222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT88605> (referer: https://www.auto1.com/v1/car-details-view/NT88605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f39da4-519b-5dc4-99bb-1a4ee724c012 with identifier: ZH98222
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f39da4-519b-5dc4-99bb-1a4ee724c012 with scrape type 1
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_6df4c8c6412381fd1fddb247be6ec30b.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_e43784c58f2660a93adf7537ff1395ad.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_53d63aac142d8bb71c84787c54fc79d4.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-04-27 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 1
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_c3003d54f41f29f84ff448274853d13e.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_3a2b6f0241b2492009e00e8b6521df34.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_e5ac1c7d4076a29e06a69ecf7891c2a8.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_d11751feab022d32cda586406f233ecf.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_9f5e70c4acddac4dfec88d1c7c8c4e26.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_df8d4dfd4d3c988fdf0425d0415ba75e.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_f8e91aadb6e3af21fa99784e1fc53a38.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_92686a43c61e22838f44fdba48fe183b.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_30e3bb47136545b9b5b5def375394cdb.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_64b6f0d516af938bb63c0b1c459fac3d.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_5c46fa6b54c2f6c305627ab638486bb3.jpg not downloaded yet
2026-04-27 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_ee584722595376b3d5f3c3948fe71b10.jpg not downloaded yet
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK12622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_ee584722595376b3d5f3c3948fe71b10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09c50>
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_ee584722595376b3d5f3c3948fe71b10.jpg saved to cache
2026-04-27 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ42521/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_5c46fa6b54c2f6c305627ab638486bb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_64b6f0d516af938bb63c0b1c459fac3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB53133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30040210>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_5c46fa6b54c2f6c305627ab638486bb3.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004cf90>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_64b6f0d516af938bb63c0b1c459fac3d.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_30e3bb47136545b9b5b5def375394cdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6ac10>
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_30e3bb47136545b9b5b5def375394cdb.jpg saved to cache
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_92686a43c61e22838f44fdba48fe183b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 10607 | hits on page: 40
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: VB21266
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for VB21266: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: RA50957
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: JU04536
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for JU04536: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: FU96820
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for FU96820: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: DS38109
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for DS38109: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: GA56830
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for GA56830: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: PG24274
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for PG24274: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: LW67845
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for LW67845: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: ZH98222
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: BZ42521
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bd010>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_92686a43c61e22838f44fdba48fe183b.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: KB53133
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: CX11621
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for CX11621: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: DW20402
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for DW20402: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: TT05180
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for TT05180: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: NG61507
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for NG61507: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: FD35505
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for FD35505: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: TZ15393
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for TZ15393: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: DV22671
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for DV22671: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: XS85074
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for XS85074: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: ED51719
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for ED51719: 0
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: SB14031
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for SB14031: 1
2026-04-27 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_f8e91aadb6e3af21fa99784e1fc53a38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: XH30741
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for XH30741: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for ZZ21826: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: JK90168
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for JK90168: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: YF83058
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for YF83058: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: PC54286
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for PC54286: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: VM03652
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for VM03652: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: YG99324
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for YG99324: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: BU23816
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for BU23816: 1
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db5190>
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_f8e91aadb6e3af21fa99784e1fc53a38.jpg saved to cache
2026-04-27 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: CA60323
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for CA60323: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: BN04464
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for BN04464: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: ET24153
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for ET24153: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: AV91835
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for AV91835: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: MB11213
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for MB11213: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: SF38506
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for SF38506: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: CE38589
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for CE38589: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: UE66313
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for UE66313: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: PB07768
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for PB07768: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: LA33826
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for LA33826: 1
2026-04-27 08:01:25 [auto1.de] INFO: Found listing with ID: KD28185
2026-04-27 08:01:25 [auto1.de] INFO: Scrape type for KD28185: 1
2026-04-27 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF78071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM11561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ02715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS15824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV81221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC87215> (referer: https://www.auto1.com/v1/car-details-view/HC87215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC51546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35249ca3-a428-54fd-9ea9-65308dcf0798 with identifier: HC87215
2026-04-27 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35249ca3-a428-54fd-9ea9-65308dcf0798 with scrape type 1
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_7136fcff6057b00b8cb3020d3a6ad38a.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_fbb1e7f844180e6e6efab5d9b0e19897.jpg not downloaded yet
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY65669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_c57c599c17091e52eb7c3e6e9cd99d50.jpg not downloaded yet
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_ee1c36cc1656e32a86f4f3b272efc646.jpg not downloaded yet
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_6eeb9c69eb826bfee8cbfc962dad813b.jpg not downloaded yet
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR24268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_fbb1e7f844180e6e6efab5d9b0e19897.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30195910>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_fbb1e7f844180e6e6efab5d9b0e19897.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB53133> (referer: https://www.auto1.com/v1/car-details-view/KB53133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-04-27 08:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with scrape type 1
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_77aa13c725cee597dabf4c8d7ec55365.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_5a0f370c2d2140c568b35afb8f10ae1e.jpg not downloaded yet
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b82a5aa140750fc15f8cc83cdcccbaa2.jpg not downloaded yet
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b710cc6f8e4c026e350536af0a7cc492.jpg not downloaded yet
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_75ab0097c6a0ad76e83f687d7e7179de.jpg not downloaded yet
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_7edc53bfefac473ba86ef0804bbcaaaf.jpg not downloaded yet
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b587f13d281fc8121fdfacd9d451440d.jpg not downloaded yet
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_620d540550131d260fff89cfc4fa2a78.jpg not downloaded yet
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN24396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_af6cec14a70fd50f9224698dbed88757.jpg not downloaded yet
2026-04-27 08:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_9250b9b7c42450759b5b74e5ca761a70.jpg not downloaded yet
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_620d540550131d260fff89cfc4fa2a78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ced50>
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_620d540550131d260fff89cfc4fa2a78.jpg saved to cache
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_9250b9b7c42450759b5b74e5ca761a70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6b4d0>
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_9250b9b7c42450759b5b74e5ca761a70.jpg saved to cache
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK12622> (referer: https://www.auto1.com/v1/car-details-view/LK12622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_af6cec14a70fd50f9224698dbed88757.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-04-27 08:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 1
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85230251b03a5b473fe0ba774538cebe.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a6bd1b60e4ea0189f709c6481e4f273b.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cb90bb870262e459bc1cfc7eda2388e5.jpg not downloaded yet
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dd390>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_af6cec14a70fd50f9224698dbed88757.jpg saved to cache
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a36b0f157321d0fdd9fa79931eef1a4f.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85e1aa131066de12d34f2421d0cf4802.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_9c5e3cbaa8850d628eb98a22f1129476.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cad3a749375d4a000da7383f186b3340.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_1528a623b72c2aaa7b39dffa04cafda5.jpg not downloaded yet
2026-04-27 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b587f13d281fc8121fdfacd9d451440d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e49f77a19e582678a07fed6d79bb534e.jpg not downloaded yet
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e413524faa058a517c4fb29dbe1e540b.jpg not downloaded yet
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30288710>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b587f13d281fc8121fdfacd9d451440d.jpg saved to cache
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_1528a623b72c2aaa7b39dffa04cafda5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcab50>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_1528a623b72c2aaa7b39dffa04cafda5.jpg saved to cache
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e413524faa058a517c4fb29dbe1e540b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015bf50>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e413524faa058a517c4fb29dbe1e540b.jpg saved to cache
2026-04-27 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e49f77a19e582678a07fed6d79bb534e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2fa90>
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e49f77a19e582678a07fed6d79bb534e.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cad3a749375d4a000da7383f186b3340.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301585d0>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cad3a749375d4a000da7383f186b3340.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_9c5e3cbaa8850d628eb98a22f1129476.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028a790>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_9c5e3cbaa8850d628eb98a22f1129476.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85e1aa131066de12d34f2421d0cf4802.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042050>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85e1aa131066de12d34f2421d0cf4802.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a36b0f157321d0fdd9fa79931eef1a4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159c50>
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a36b0f157321d0fdd9fa79931eef1a4f.jpg saved to cache
2026-04-27 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cb90bb870262e459bc1cfc7eda2388e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301959d0>
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cb90bb870262e459bc1cfc7eda2388e5.jpg saved to cache
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a6bd1b60e4ea0189f709c6481e4f273b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85230251b03a5b473fe0ba774538cebe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0a390>
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a6bd1b60e4ea0189f709c6481e4f273b.jpg saved to cache
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc95d0>
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85230251b03a5b473fe0ba774538cebe.jpg saved to cache
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38903159-416f-5f85-8a70-45e6cbe00e81
2026-04-27 08:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38903159-416f-5f85-8a70-45e6cbe00e81, skipping ID generation
2026-04-27 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 1
2026-04-27 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38903159-416f-5f85-8a70-45e6cbe00e81 sending to next pipeline
2026-04-27 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38903159-416f-5f85-8a70-45e6cbe00e81, identifier: LK12622
2026-04-27 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-04-27 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-04-27 08:01:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622 to the API
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85230251b03a5b473fe0ba774538cebe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Helvesiek',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-04-28T15:53:34Z',
 'fuel_type': 'petrol',
 'id': '38903159-416f-5f85-8a70-45e6cbe00e81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.2161,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12622',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'location_confidence': 'geocoded',
 'longitude': 9.4915,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 118433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85230251b03a5b473fe0ba774538cebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a6bd1b60e4ea0189f709c6481e4f273b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cb90bb870262e459bc1cfc7eda2388e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_a36b0f157321d0fdd9fa79931eef1a4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_85e1aa131066de12d34f2421d0cf4802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_9c5e3cbaa8850d628eb98a22f1129476.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_cad3a749375d4a000da7383f186b3340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_1528a623b72c2aaa7b39dffa04cafda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e49f77a19e582678a07fed6d79bb534e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38903159-416f-5f85-8a70-45e6cbe00e81/38903159-416f-5f85-8a70-45e6cbe00e81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/a3/d0a3d6413996960a4c40e38599315044/pa/LK12622_e413524faa058a517c4fb29dbe1e540b.jpg',
             'Width': 800}],
 'postal_code': '27389',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2014-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-04-27 08:01:34 [auto1.de] INFO: Saving data for LK12622: {'created_time': 1777276894.226761, 'last_price_update_time': 1777276894.226775, 'has_photos': True, 'auction_closing_time': 1777391614.0}
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_7edc53bfefac473ba86ef0804bbcaaaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB14031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b710cc6f8e4c026e350536af0a7cc492.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b067d0>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_7edc53bfefac473ba86ef0804bbcaaaf.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d68e10>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b710cc6f8e4c026e350536af0a7cc492.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_75ab0097c6a0ad76e83f687d7e7179de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b82a5aa140750fc15f8cc83cdcccbaa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_5a0f370c2d2140c568b35afb8f10ae1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a71b10>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_75ab0097c6a0ad76e83f687d7e7179de.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_77aa13c725cee597dabf4c8d7ec55365.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053cd0>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b82a5aa140750fc15f8cc83cdcccbaa2.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0c190>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_5a0f370c2d2140c568b35afb8f10ae1e.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1f450>
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_77aa13c725cee597dabf4c8d7ec55365.jpg saved to cache
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965
2026-04-27 08:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965, skipping ID generation
2026-04-27 08:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with scrape type 1
2026-04-27 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 sending to next pipeline
2026-04-27 08:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965, identifier: KB53133
2026-04-27 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-04-27 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-04-27 08:01:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133 to the API
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_77aa13c725cee597dabf4c8d7ec55365.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '3.0L',
 'engine_horse_power': 173,
 'expiration_date': '2026-04-28T15:08:26Z',
 'fuel_type': 'diesel',
 'id': '7c0a4252-a7c9-5d30-bfe5-74574a9ce965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB53133',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 237174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_77aa13c725cee597dabf4c8d7ec55365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_5a0f370c2d2140c568b35afb8f10ae1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b82a5aa140750fc15f8cc83cdcccbaa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b710cc6f8e4c026e350536af0a7cc492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_75ab0097c6a0ad76e83f687d7e7179de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_7edc53bfefac473ba86ef0804bbcaaaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_b587f13d281fc8121fdfacd9d451440d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_620d540550131d260fff89cfc4fa2a78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_af6cec14a70fd50f9224698dbed88757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c0a4252-a7c9-5d30-bfe5-74574a9ce965/7c0a4252-a7c9-5d30-bfe5-74574a9ce965_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/4e/054ebfd7a9ca3de42bc15026777551fd/pa/KB53133_9250b9b7c42450759b5b74e5ca761a70.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2007-11-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2007}
2026-04-27 08:01:35 [auto1.de] INFO: Saving data for KB53133: {'created_time': 1777276895.351619, 'last_price_update_time': 1777276895.351628, 'has_photos': True, 'auction_closing_time': 1777388906.0}
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_6eeb9c69eb826bfee8cbfc962dad813b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA33826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d69f50>
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_6eeb9c69eb826bfee8cbfc962dad813b.jpg saved to cache
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ42521> (referer: https://www.auto1.com/v1/car-details-view/BZ42521/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_c57c599c17091e52eb7c3e6e9cd99d50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_7136fcff6057b00b8cb3020d3a6ad38a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_ee1c36cc1656e32a86f4f3b272efc646.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d824d25-600c-5347-87d4-81cd7070751d with identifier: BZ42521
2026-04-27 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d824d25-600c-5347-87d4-81cd7070751d with scrape type 1
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_b5c13e3c497f52b8e227bb73ec6b48ca.jpg not downloaded yet
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_fb06a4d43f99627cde461c79d1d0ea21.jpg not downloaded yet
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_37cb1843a7a26bb7fc932d46d44ae302.jpg not downloaded yet
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ae950>
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_c57c599c17091e52eb7c3e6e9cd99d50.jpg saved to cache
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_6ec7cc2176b68e14ef85c2ee6e9b26ac.jpg not downloaded yet
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_58ed725ea187e5cdfb512469e9b83c6d.jpg not downloaded yet
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_2b30b50cdb3d6e1ebfcde415af9a552d.jpg not downloaded yet
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014ef10>
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_7136fcff6057b00b8cb3020d3a6ad38a.jpg saved to cache
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea8950>
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_ee1c36cc1656e32a86f4f3b272efc646.jpg saved to cache
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35249ca3-a428-54fd-9ea9-65308dcf0798
2026-04-27 08:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35249ca3-a428-54fd-9ea9-65308dcf0798, skipping ID generation
2026-04-27 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35249ca3-a428-54fd-9ea9-65308dcf0798 with scrape type 1
2026-04-27 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35249ca3-a428-54fd-9ea9-65308dcf0798 sending to next pipeline
2026-04-27 08:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35249ca3-a428-54fd-9ea9-65308dcf0798, identifier: HC87215
2026-04-27 08:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35249ca3-a428-54fd-9ea9-65308dcf0798 with identifier: HC87215
2026-04-27 08:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35249ca3-a428-54fd-9ea9-65308dcf0798 with identifier: HC87215
2026-04-27 08:01:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35249ca3-a428-54fd-9ea9-65308dcf0798 with identifier: HC87215 to the API
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_ee1c36cc1656e32a86f4f3b272efc646.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Karlskron',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:48:59Z',
 'fuel_type': 'petrol',
 'id': '35249ca3-a428-54fd-9ea9-65308dcf0798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC87215',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'BMW',
 'model': '3er',
 'odometer': 214180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_7136fcff6057b00b8cb3020d3a6ad38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_fbb1e7f844180e6e6efab5d9b0e19897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_c57c599c17091e52eb7c3e6e9cd99d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_ee1c36cc1656e32a86f4f3b272efc646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_35249ca3-a428-54fd-9ea9-65308dcf0798/35249ca3-a428-54fd-9ea9-65308dcf0798_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/00/2c00c485566c77077e0e2c23e9d74ec9/pa/HC87215_6eeb9c69eb826bfee8cbfc962dad813b.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2009-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-04-27 08:01:36 [auto1.de] INFO: Saving data for HC87215: {'created_time': 1777276896.292247, 'last_price_update_time': 1777276896.292259, 'has_photos': True, 'auction_closing_time': 1777391339.0}
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ02715> (referer: https://www.auto1.com/v1/car-details-view/FZ02715/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-04-27 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with scrape type 1
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f48c018529986f6f1de7c016e821d6bb.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_283468d55d7ebbcb299df8cdfca0dd5f.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_1479b929634dccc38ab658a14b4de869.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f6c9f2cebf591bdcaf399fa78e7388f3.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_0f7dbfb0635ac9179b1379146078ea1e.jpg not downloaded yet
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_2b30b50cdb3d6e1ebfcde415af9a552d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_90359787422deadb787a69ac2bd1fa79.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_80a2ddf6c864b903196237caa740d556.jpg not downloaded yet
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA50957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_a0f5714e91189980d1b7d3736cf83563.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_44571cb59a7ef22b54af060d39fb9838.jpg not downloaded yet
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_793c2cae17487813cb7cf30520559b61.jpg not downloaded yet
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016f250>
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_2b30b50cdb3d6e1ebfcde415af9a552d.jpg saved to cache
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_80a2ddf6c864b903196237caa740d556.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_793c2cae17487813cb7cf30520559b61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_0f7dbfb0635ac9179b1379146078ea1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6bb90>
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_80a2ddf6c864b903196237caa740d556.jpg saved to cache
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6b5d0>
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_793c2cae17487813cb7cf30520559b61.jpg saved to cache
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e69b90>
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_0f7dbfb0635ac9179b1379146078ea1e.jpg saved to cache
2026-04-27 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_44571cb59a7ef22b54af060d39fb9838.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_a0f5714e91189980d1b7d3736cf83563.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320991d0>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_44571cb59a7ef22b54af060d39fb9838.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_90359787422deadb787a69ac2bd1fa79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016ffd0>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_a0f5714e91189980d1b7d3736cf83563.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f6c9f2cebf591bdcaf399fa78e7388f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042e10>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_90359787422deadb787a69ac2bd1fa79.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f9150>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f6c9f2cebf591bdcaf399fa78e7388f3.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_1479b929634dccc38ab658a14b4de869.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_283468d55d7ebbcb299df8cdfca0dd5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41a90>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_1479b929634dccc38ab658a14b4de869.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f48c018529986f6f1de7c016e821d6bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4d750>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_283468d55d7ebbcb299df8cdfca0dd5f.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6eed0>
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f48c018529986f6f1de7c016e821d6bb.jpg saved to cache
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e
2026-04-27 08:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e, skipping ID generation
2026-04-27 08:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with scrape type 1
2026-04-27 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e sending to next pipeline
2026-04-27 08:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e, identifier: FZ02715
2026-04-27 08:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-04-27 08:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-04-27 08:01:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715 to the API
2026-04-27 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f48c018529986f6f1de7c016e821d6bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': 'Rental',
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:48:39Z',
 'fuel_type': 'diesel',
 'id': 'd8b3da4c-b2e0-5e61-8b3b-d96b6121be0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ02715',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 164597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f48c018529986f6f1de7c016e821d6bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_283468d55d7ebbcb299df8cdfca0dd5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_1479b929634dccc38ab658a14b4de869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_f6c9f2cebf591bdcaf399fa78e7388f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_0f7dbfb0635ac9179b1379146078ea1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_90359787422deadb787a69ac2bd1fa79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_80a2ddf6c864b903196237caa740d556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_a0f5714e91189980d1b7d3736cf83563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_44571cb59a7ef22b54af060d39fb9838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e/d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eefd3f0ec7a1559ac6d364a367eb3ce/pa/FZ02715_793c2cae17487813cb7cf30520559b61.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2014}
2026-04-27 08:01:41 [auto1.de] INFO: Saving data for FZ02715: {'created_time': 1777276901.181706, 'last_price_update_time': 1777276901.181716, 'has_photos': True, 'auction_closing_time': 1777391319.0}
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_58ed725ea187e5cdfb512469e9b83c6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6a710>
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_58ed725ea187e5cdfb512469e9b83c6d.jpg saved to cache
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_6ec7cc2176b68e14ef85c2ee6e9b26ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0b150>
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_6ec7cc2176b68e14ef85c2ee6e9b26ac.jpg saved to cache
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_37cb1843a7a26bb7fc932d46d44ae302.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1dd10>
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_37cb1843a7a26bb7fc932d46d44ae302.jpg saved to cache
2026-04-27 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_fb06a4d43f99627cde461c79d1d0ea21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_b5c13e3c497f52b8e227bb73ec6b48ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bcb50>
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_fb06a4d43f99627cde461c79d1d0ea21.jpg saved to cache
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301df550>
2026-04-27 08:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_b5c13e3c497f52b8e227bb73ec6b48ca.jpg saved to cache
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d824d25-600c-5347-87d4-81cd7070751d
2026-04-27 08:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d824d25-600c-5347-87d4-81cd7070751d, skipping ID generation
2026-04-27 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d824d25-600c-5347-87d4-81cd7070751d with scrape type 1
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d824d25-600c-5347-87d4-81cd7070751d sending to next pipeline
2026-04-27 08:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d824d25-600c-5347-87d4-81cd7070751d, identifier: BZ42521
2026-04-27 08:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d824d25-600c-5347-87d4-81cd7070751d with identifier: BZ42521
2026-04-27 08:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d824d25-600c-5347-87d4-81cd7070751d with identifier: BZ42521
2026-04-27 08:01:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d824d25-600c-5347-87d4-81cd7070751d with identifier: BZ42521 to the API
2026-04-27 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_b5c13e3c497f52b8e227bb73ec6b48ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Ellerau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:09:09Z',
 'fuel_type': 'petrol',
 'id': '0d824d25-600c-5347-87d4-81cd7070751d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ42521',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'BMW',
 'model': '1er',
 'odometer': 183489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_b5c13e3c497f52b8e227bb73ec6b48ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_fb06a4d43f99627cde461c79d1d0ea21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_37cb1843a7a26bb7fc932d46d44ae302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_6ec7cc2176b68e14ef85c2ee6e9b26ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_58ed725ea187e5cdfb512469e9b83c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d824d25-600c-5347-87d4-81cd7070751d/0d824d25-600c-5347-87d4-81cd7070751d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ca/04ca70a8fd6a7ae9920ce6c2472c984c/pa/BZ42521_2b30b50cdb3d6e1ebfcde415af9a552d.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2006-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-04-27 08:01:42 [auto1.de] INFO: Saving data for BZ42521: {'created_time': 1777276902.465457, 'last_price_update_time': 1777276902.465468, 'has_photos': True, 'auction_closing_time': 1777388949.0}
2026-04-27 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV81221> (referer: https://www.auto1.com/v1/car-details-view/MV81221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4cffa99-a7fb-5d7a-ae52-a1406120c39f with identifier: MV81221
2026-04-27 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f with scrape type 1
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_561fd29be9df3346315ada52e1207f0b.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_7ff5c6221869d474f9ce011f29af7138.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_618fe126912bd674cfbe395ecde78434.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_eef4fcf1956e10a05c838e9f4518b950.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_b1e98eb330313454a66cae70a0695774.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_22aa6fb3a5ef557064132dbb8ebf36c4.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_2a70caa44dc1d34e7b0cedbb70596e5d.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_ceab3f05304412b0e24d78ccf48260b5.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_3b7e26773e89cc1b8f05b1f56e09bbef.jpg not downloaded yet
2026-04-27 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_9f2451698a38682b3dda1d705480b37f.jpg not downloaded yet
2026-04-27 08:01:43 [scrapy.extensions.logstats] INFO: Crawled 477 pages (at 39 pages/min), scraped 203 items (at 18 items/min)
2026-04-27 08:01:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:02:43 [scrapy.extensions.logstats] INFO: Crawled 477 pages (at 0 pages/min), scraped 203 items (at 0 items/min)
2026-04-27 08:02:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC51546> (referer: https://www.auto1.com/v1/car-details-view/UC51546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f23e25-3416-55b7-a1d3-f4d18a48899e with identifier: UC51546
2026-04-27 08:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f23e25-3416-55b7-a1d3-f4d18a48899e with scrape type 1
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f2902be2713a0511e4b4060a5e93e878.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e38d46fee270f12548ceb1bb6a5ce2e8.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_2cc06b30cff7879a062c68773910e582.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f5fc90290068f8c795d4433f558f63fb.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_1bca41e5193589d2fa231c6812ccb20c.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e6730acffed18e6bb88d787498b696d9.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_4c8ec8437a1f74cbae02f0a0cfa45a38.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_72a71805bf3ed6fa2c3ddf0450444525.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_40ffa08bf6a20b6c7b32b13356d91499.jpg not downloaded yet
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_d5456198439cccfa163642c372c9b9ba.jpg not downloaded yet
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_9f2451698a38682b3dda1d705480b37f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_d5456198439cccfa163642c372c9b9ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e08150>
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_9f2451698a38682b3dda1d705480b37f.jpg saved to cache
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e08ad0>
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_d5456198439cccfa163642c372c9b9ba.jpg saved to cache
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_40ffa08bf6a20b6c7b32b13356d91499.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051a50>
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_40ffa08bf6a20b6c7b32b13356d91499.jpg saved to cache
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_72a71805bf3ed6fa2c3ddf0450444525.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_4c8ec8437a1f74cbae02f0a0cfa45a38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6afd0>
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_72a71805bf3ed6fa2c3ddf0450444525.jpg saved to cache
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d699d0>
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_4c8ec8437a1f74cbae02f0a0cfa45a38.jpg saved to cache
2026-04-27 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e6730acffed18e6bb88d787498b696d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015ae10>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e6730acffed18e6bb88d787498b696d9.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_1bca41e5193589d2fa231c6812ccb20c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f5fc90290068f8c795d4433f558f63fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30040550>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_1bca41e5193589d2fa231c6812ccb20c.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73ed0>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f5fc90290068f8c795d4433f558f63fb.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_2cc06b30cff7879a062c68773910e582.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e38d46fee270f12548ceb1bb6a5ce2e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f2902be2713a0511e4b4060a5e93e878.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_3b7e26773e89cc1b8f05b1f56e09bbef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d690>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_2cc06b30cff7879a062c68773910e582.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6bb10>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e38d46fee270f12548ceb1bb6a5ce2e8.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6eed0>
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f2902be2713a0511e4b4060a5e93e878.jpg saved to cache
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58f23e25-3416-55b7-a1d3-f4d18a48899e
2026-04-27 08:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58f23e25-3416-55b7-a1d3-f4d18a48899e, skipping ID generation
2026-04-27 08:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f23e25-3416-55b7-a1d3-f4d18a48899e with scrape type 1
2026-04-27 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58f23e25-3416-55b7-a1d3-f4d18a48899e sending to next pipeline
2026-04-27 08:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58f23e25-3416-55b7-a1d3-f4d18a48899e, identifier: UC51546
2026-04-27 08:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58f23e25-3416-55b7-a1d3-f4d18a48899e with identifier: UC51546
2026-04-27 08:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58f23e25-3416-55b7-a1d3-f4d18a48899e with identifier: UC51546
2026-04-27 08:02:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58f23e25-3416-55b7-a1d3-f4d18a48899e with identifier: UC51546 to the API
2026-04-27 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f2902be2713a0511e4b4060a5e93e878.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'city': 'Ketzin',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:41:41Z',
 'fuel_type': 'diesel',
 'id': '58f23e25-3416-55b7-a1d3-f4d18a48899e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC51546',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 221360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f2902be2713a0511e4b4060a5e93e878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e38d46fee270f12548ceb1bb6a5ce2e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_2cc06b30cff7879a062c68773910e582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_f5fc90290068f8c795d4433f558f63fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_1bca41e5193589d2fa231c6812ccb20c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_e6730acffed18e6bb88d787498b696d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_4c8ec8437a1f74cbae02f0a0cfa45a38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_72a71805bf3ed6fa2c3ddf0450444525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_40ffa08bf6a20b6c7b32b13356d91499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f23e25-3416-55b7-a1d3-f4d18a48899e/58f23e25-3416-55b7-a1d3-f4d18a48899e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/a5/7ba5988a11b8be36e9e910bb8ed92074/pa/UC51546_d5456198439cccfa163642c372c9b9ba.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2009-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-04-27 08:02:49 [auto1.de] INFO: Saving data for UC51546: {'created_time': 1777276969.245609, 'last_price_update_time': 1777276969.245618, 'has_photos': True, 'auction_closing_time': 1777390901.0}
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_ceab3f05304412b0e24d78ccf48260b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY65669> (referer: https://www.auto1.com/v1/car-details-view/XY65669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN24396> (referer: https://www.auto1.com/v1/car-details-view/HN24396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e350>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_3b7e26773e89cc1b8f05b1f56e09bbef.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_2a70caa44dc1d34e7b0cedbb70596e5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30050e90>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_ceab3f05304412b0e24d78ccf48260b5.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3d0782-1334-5f28-adf3-faa36daeab07 with identifier: XY65669
2026-04-27 08:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3d0782-1334-5f28-adf3-faa36daeab07 with scrape type 1
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_54f773eeb02a01e29c6fb9c9ee36c0bf.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-04-27 08:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 1
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_2b9fc55efb92b283a7c56f775aca2ade.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_18c40357a54db251b308b1b16dd762cb.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_3651e5f8bcddea4a10cd6ef091e6e259.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_cc83c8d4010d8704fd01c390444cab06.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_9dc7157a82eb4fa996283fc67031c1bc.jpg not downloaded yet
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b750>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_2a70caa44dc1d34e7b0cedbb70596e5d.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_8cb3a60aa45b955921193464785831d8.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_a8a81965472863ac831fccc123b36444.jpg not downloaded yet
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_eef4fcf1956e10a05c838e9f4518b950.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_875cea3ce3eb90b82ee2ef433e98dc54.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_41d5447d3edbf0fc4207e04c5cc717ea.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_d737e1aa37d5e52fb70cb099ba8f85ff.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_73387cf7330be39585fd8ea9cf2cd5e1.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_b67e54f71a3e1523273a7f4da81b709c.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_f8204cea8fd1e257cbe4aae22d9e1970.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_5783f615060fc6b5d2a1410d9912e00b.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_8cab5aac5fb198d8e0d347fceec01468.jpg not downloaded yet
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_b1e98eb330313454a66cae70a0695774.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_22aa6fb3a5ef557064132dbb8ebf36c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_e3874c6e0be77c4a53c3dd4a40372cc9.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_558cae08f9f005f4d4951777f3b1f13d.jpg not downloaded yet
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b83350>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_eef4fcf1956e10a05c838e9f4518b950.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_09d0005af1b307260ed2b766eeed6468.jpg not downloaded yet
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_bb9db84a4c7726b248d36fe8d65a4bed.jpg not downloaded yet
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_9dc7157a82eb4fa996283fc67031c1bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65410>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_b1e98eb330313454a66cae70a0695774.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f61b950>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_22aa6fb3a5ef557064132dbb8ebf36c4.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_8cab5aac5fb198d8e0d347fceec01468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_5783f615060fc6b5d2a1410d9912e00b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f4c90>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_9dc7157a82eb4fa996283fc67031c1bc.jpg saved to cache
2026-04-27 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_09d0005af1b307260ed2b766eeed6468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_558cae08f9f005f4d4951777f3b1f13d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4d910>
2026-04-27 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_8cab5aac5fb198d8e0d347fceec01468.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_e3874c6e0be77c4a53c3dd4a40372cc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1910>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_5783f615060fc6b5d2a1410d9912e00b.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_bb9db84a4c7726b248d36fe8d65a4bed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196690>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_09d0005af1b307260ed2b766eeed6468.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9ea90>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_558cae08f9f005f4d4951777f3b1f13d.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_f8204cea8fd1e257cbe4aae22d9e1970.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300af7d0>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_e3874c6e0be77c4a53c3dd4a40372cc9.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f79d0>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_bb9db84a4c7726b248d36fe8d65a4bed.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee2ad0>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_f8204cea8fd1e257cbe4aae22d9e1970.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_b67e54f71a3e1523273a7f4da81b709c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_73387cf7330be39585fd8ea9cf2cd5e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_d737e1aa37d5e52fb70cb099ba8f85ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_a8a81965472863ac831fccc123b36444.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_41d5447d3edbf0fc4207e04c5cc717ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_8cb3a60aa45b955921193464785831d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34f50>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_b67e54f71a3e1523273a7f4da81b709c.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026fc50>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_73387cf7330be39585fd8ea9cf2cd5e1.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_3651e5f8bcddea4a10cd6ef091e6e259.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9250>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_d737e1aa37d5e52fb70cb099ba8f85ff.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd6750>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_a8a81965472863ac831fccc123b36444.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc8250>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_41d5447d3edbf0fc4207e04c5cc717ea.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_875cea3ce3eb90b82ee2ef433e98dc54.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_cc83c8d4010d8704fd01c390444cab06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43a10>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_8cb3a60aa45b955921193464785831d8.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a371d0>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_3651e5f8bcddea4a10cd6ef091e6e259.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_2b9fc55efb92b283a7c56f775aca2ade.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_18c40357a54db251b308b1b16dd762cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7610>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_875cea3ce3eb90b82ee2ef433e98dc54.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_618fe126912bd674cfbe395ecde78434.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_54f773eeb02a01e29c6fb9c9ee36c0bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300439d0>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_cc83c8d4010d8704fd01c390444cab06.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4b50>
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_2b9fc55efb92b283a7c56f775aca2ade.jpg saved to cache
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79081c0b-3212-5214-9001-bae5c3b59581
2026-04-27 08:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79081c0b-3212-5214-9001-bae5c3b59581, skipping ID generation
2026-04-27 08:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 1
2026-04-27 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79081c0b-3212-5214-9001-bae5c3b59581 sending to next pipeline
2026-04-27 08:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79081c0b-3212-5214-9001-bae5c3b59581, identifier: HN24396
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0f590>
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_18c40357a54db251b308b1b16dd762cb.jpg saved to cache
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-04-27 08:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-04-27 08:02:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396 to the API
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_2b9fc55efb92b283a7c56f775aca2ade.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'city': 'Ketzin',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:05:13Z',
 'fuel_type': 'petrol',
 'id': '79081c0b-3212-5214-9001-bae5c3b59581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN24396',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Peugeot',
 'model': '107',
 'odometer': 40182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_2b9fc55efb92b283a7c56f775aca2ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_3651e5f8bcddea4a10cd6ef091e6e259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_9dc7157a82eb4fa996283fc67031c1bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_a8a81965472863ac831fccc123b36444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_41d5447d3edbf0fc4207e04c5cc717ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_73387cf7330be39585fd8ea9cf2cd5e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_f8204cea8fd1e257cbe4aae22d9e1970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_8cab5aac5fb198d8e0d347fceec01468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_558cae08f9f005f4d4951777f3b1f13d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79081c0b-3212-5214-9001-bae5c3b59581/79081c0b-3212-5214-9001-bae5c3b59581_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/30/5130a4a3b8a06773f55bedc6a436d1fe/pa/HN24396_bb9db84a4c7726b248d36fe8d65a4bed.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2009-06-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2009}
2026-04-27 08:02:51 [auto1.de] INFO: Saving data for HN24396: {'created_time': 1777276971.670466, 'last_price_update_time': 1777276971.670477, 'has_photos': True, 'auction_closing_time': 1777388713.0}
2026-04-27 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_561fd29be9df3346315ada52e1207f0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_7ff5c6221869d474f9ce011f29af7138.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA33826> (referer: https://www.auto1.com/v1/car-details-view/LA33826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017f690>
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_618fe126912bd674cfbe395ecde78434.jpg saved to cache
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f4bd0>
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_54f773eeb02a01e29c6fb9c9ee36c0bf.jpg saved to cache
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b3d0782-1334-5f28-adf3-faa36daeab07
2026-04-27 08:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b3d0782-1334-5f28-adf3-faa36daeab07, skipping ID generation
2026-04-27 08:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3d0782-1334-5f28-adf3-faa36daeab07 with scrape type 1
2026-04-27 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b3d0782-1334-5f28-adf3-faa36daeab07 sending to next pipeline
2026-04-27 08:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b3d0782-1334-5f28-adf3-faa36daeab07, identifier: XY65669
2026-04-27 08:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b3d0782-1334-5f28-adf3-faa36daeab07 with identifier: XY65669
2026-04-27 08:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b3d0782-1334-5f28-adf3-faa36daeab07 with identifier: XY65669
2026-04-27 08:02:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b3d0782-1334-5f28-adf3-faa36daeab07 with identifier: XY65669 to the API
2026-04-27 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_54f773eeb02a01e29c6fb9c9ee36c0bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Ketzin',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-04-28T15:42:34Z',
 'fuel_type': 'diesel',
 'id': '4b3d0782-1334-5f28-adf3-faa36daeab07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY65669',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 60650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_54f773eeb02a01e29c6fb9c9ee36c0bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_18c40357a54db251b308b1b16dd762cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_cc83c8d4010d8704fd01c390444cab06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_8cb3a60aa45b955921193464785831d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_875cea3ce3eb90b82ee2ef433e98dc54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_d737e1aa37d5e52fb70cb099ba8f85ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_b67e54f71a3e1523273a7f4da81b709c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_5783f615060fc6b5d2a1410d9912e00b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_e3874c6e0be77c4a53c3dd4a40372cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b3d0782-1334-5f28-adf3-faa36daeab07/4b3d0782-1334-5f28-adf3-faa36daeab07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/b0/1eb0b4dd784c150068986f6cb90b0b25/pa/XY65669_09d0005af1b307260ed2b766eeed6468.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-04-27 08:02:52 [auto1.de] INFO: Saving data for XY65669: {'created_time': 1777276972.198845, 'last_price_update_time': 1777276972.198856, 'has_photos': True, 'auction_closing_time': 1777390954.0}
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4690>
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_561fd29be9df3346315ada52e1207f0b.jpg saved to cache
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006ddd0>
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_7ff5c6221869d474f9ce011f29af7138.jpg saved to cache
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f
2026-04-27 08:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4cffa99-a7fb-5d7a-ae52-a1406120c39f, skipping ID generation
2026-04-27 08:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f with scrape type 1
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4cffa99-a7fb-5d7a-ae52-a1406120c39f sending to next pipeline
2026-04-27 08:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4cffa99-a7fb-5d7a-ae52-a1406120c39f, identifier: MV81221
2026-04-27 08:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-04-27 08:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with scrape type 1
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_77fd3de1414539c9ecf1a6c8fd99f9fc.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4cffa99-a7fb-5d7a-ae52-a1406120c39f with identifier: MV81221
2026-04-27 08:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4cffa99-a7fb-5d7a-ae52-a1406120c39f with identifier: MV81221
2026-04-27 08:02:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4cffa99-a7fb-5d7a-ae52-a1406120c39f with identifier: MV81221 to the API
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_7ff5c6221869d474f9ce011f29af7138.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:01:31Z',
 'fuel_type': 'diesel',
 'id': 'a4cffa99-a7fb-5d7a-ae52-a1406120c39f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV81221',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 102904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_561fd29be9df3346315ada52e1207f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_7ff5c6221869d474f9ce011f29af7138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_618fe126912bd674cfbe395ecde78434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_eef4fcf1956e10a05c838e9f4518b950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_b1e98eb330313454a66cae70a0695774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_22aa6fb3a5ef557064132dbb8ebf36c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_2a70caa44dc1d34e7b0cedbb70596e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_ceab3f05304412b0e24d78ccf48260b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_3b7e26773e89cc1b8f05b1f56e09bbef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4cffa99-a7fb-5d7a-ae52-a1406120c39f/a4cffa99-a7fb-5d7a-ae52-a1406120c39f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d5/aad581e55f617d24fc272c28cf7f3c84/pa/MV81221_9f2451698a38682b3dda1d705480b37f.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2016-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2016}
2026-04-27 08:02:52 [auto1.de] INFO: Saving data for MV81221: {'created_time': 1777276972.749859, 'last_price_update_time': 1777276972.749868, 'has_photos': True, 'auction_closing_time': 1777388491.0}
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_b7ba357a90f54300419fe017228566a2.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f087d94d899f192f4fd9105a4a5af11d.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_43f969dfc5a04144caccb634634e9038.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f8a4951c409a75b7f9799266eed3b587.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_42831da82d508dbf56b0682eb993e8a0.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_4228c31169382f54a4d89bc84a7cc66d.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_6087a219ff560708baca19f4250db855.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_d53fa810733c330b41893550a409eb8c.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_8949ca471ab6bf99b5140171868b33eb.jpg not downloaded yet
2026-04-27 08:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB07768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_8949ca471ab6bf99b5140171868b33eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b80f50>
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_8949ca471ab6bf99b5140171868b33eb.jpg saved to cache
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_d53fa810733c330b41893550a409eb8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b80210>
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_d53fa810733c330b41893550a409eb8c.jpg saved to cache
2026-04-27 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE66313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_6087a219ff560708baca19f4250db855.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dc810>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_6087a219ff560708baca19f4250db855.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_4228c31169382f54a4d89bc84a7cc66d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1f190>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_4228c31169382f54a4d89bc84a7cc66d.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA50957> (referer: https://www.auto1.com/v1/car-details-view/RA50957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73769671-7e9b-54b8-938d-d860d18b377e with identifier: RA50957
2026-04-27 08:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73769671-7e9b-54b8-938d-d860d18b377e with scrape type 1
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_32dd4c24c06fbb947ca92f07fe261046.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_aff7bd8f55d8fcd1de11a905bcd58cb4.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_bd9bd23e0086195762deb63a62be070a.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_175536c348741c736df5ac0b457754bc.jpg not downloaded yet
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_42831da82d508dbf56b0682eb993e8a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_91ae80ce17b5fb4dc44fb83f70a484d9.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_4c28d701a219c142a6910b2a844b7707.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_a89c2766881c2207bb3e317045dbea6a.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_80a9c2a734dd17ea96d66479ae843128.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_8b74a2fc5a6aef33cdeb51d99ca86f15.jpg not downloaded yet
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_f1e4d45f0c7fa394ffc934cc8c1d9b1a.jpg not downloaded yet
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b80090>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_42831da82d508dbf56b0682eb993e8a0.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_175536c348741c736df5ac0b457754bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a707d0>
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_175536c348741c736df5ac0b457754bc.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_f1e4d45f0c7fa394ffc934cc8c1d9b1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003e390>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_f1e4d45f0c7fa394ffc934cc8c1d9b1a.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_8b74a2fc5a6aef33cdeb51d99ca86f15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a59a50>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_8b74a2fc5a6aef33cdeb51d99ca86f15.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_80a9c2a734dd17ea96d66479ae843128.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB14031> (referer: https://www.auto1.com/v1/car-details-view/SB14031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003e6d0>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_80a9c2a734dd17ea96d66479ae843128.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-04-27 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with scrape type 1
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_918b133e26fd3989ea4e122780c03fe4.jpg not downloaded yet
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_a89c2766881c2207bb3e317045dbea6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a34abdc8ed3e177cd44daaef7c7b0cc1.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_fa2fd536a21304dfa7f7d154d2f6cb36.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_82fea46dcca3f414aa68a0fa4f61e385.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_8e8760b401027b35f544c82a84db2be0.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a532beff8a6909399280abec00c97751.jpg not downloaded yet
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_918b133e26fd3989ea4e122780c03fe4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a594b15fef83af3a2d856c6866ce307a.jpg not downloaded yet
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_4c28d701a219c142a6910b2a844b7707.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_bc58091f4fc62699cf48fb9c38a432f0.jpg not downloaded yet
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208a410>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_a89c2766881c2207bb3e317045dbea6a.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_dcb5d35b10b4c9afb9f918e2dd9a7b42.jpg not downloaded yet
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_df68aad98c46c4c6e84aa540a0508787.jpg not downloaded yet
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d630d0>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_918b133e26fd3989ea4e122780c03fe4.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e76490>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_4c28d701a219c142a6910b2a844b7707.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a532beff8a6909399280abec00c97751.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a594b15fef83af3a2d856c6866ce307a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_dcb5d35b10b4c9afb9f918e2dd9a7b42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c2550>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a532beff8a6909399280abec00c97751.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30058390>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a594b15fef83af3a2d856c6866ce307a.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_df68aad98c46c4c6e84aa540a0508787.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1110>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_dcb5d35b10b4c9afb9f918e2dd9a7b42.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_bc58091f4fc62699cf48fb9c38a432f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e405d0>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_df68aad98c46c4c6e84aa540a0508787.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF38506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1b90>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_bc58091f4fc62699cf48fb9c38a432f0.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_82fea46dcca3f414aa68a0fa4f61e385.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_8e8760b401027b35f544c82a84db2be0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_fa2fd536a21304dfa7f7d154d2f6cb36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2150>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_82fea46dcca3f414aa68a0fa4f61e385.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_91ae80ce17b5fb4dc44fb83f70a484d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37c90>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_8e8760b401027b35f544c82a84db2be0.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a34abdc8ed3e177cd44daaef7c7b0cc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db7050>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_fa2fd536a21304dfa7f7d154d2f6cb36.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f4cd0>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_91ae80ce17b5fb4dc44fb83f70a484d9.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3f410>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a34abdc8ed3e177cd44daaef7c7b0cc1.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5
2026-04-27 08:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5, skipping ID generation
2026-04-27 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with scrape type 1
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 sending to next pipeline
2026-04-27 08:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5, identifier: SB14031
2026-04-27 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-04-27 08:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-04-27 08:02:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031 to the API
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a34abdc8ed3e177cd44daaef7c7b0cc1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:20:36Z',
 'fuel_type': 'petrol',
 'id': '1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB14031',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Peugeot',
 'model': '308',
 'odometer': 114485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_918b133e26fd3989ea4e122780c03fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a34abdc8ed3e177cd44daaef7c7b0cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_fa2fd536a21304dfa7f7d154d2f6cb36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_82fea46dcca3f414aa68a0fa4f61e385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_8e8760b401027b35f544c82a84db2be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a532beff8a6909399280abec00c97751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_a594b15fef83af3a2d856c6866ce307a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_bc58091f4fc62699cf48fb9c38a432f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_dcb5d35b10b4c9afb9f918e2dd9a7b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5/1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/24/7524012c76da1756afc874f41bcbe5d4/pa/SB14031_df68aad98c46c4c6e84aa540a0508787.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2015-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-04-27 08:02:59 [auto1.de] INFO: Saving data for SB14031: {'created_time': 1777276979.800823, 'last_price_update_time': 1777276979.800832, 'has_photos': True, 'auction_closing_time': 1777389636.0}
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_bd9bd23e0086195762deb63a62be070a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_aff7bd8f55d8fcd1de11a905bcd58cb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f8a4951c409a75b7f9799266eed3b587.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_32dd4c24c06fbb947ca92f07fe261046.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34190>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_bd9bd23e0086195762deb63a62be070a.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b010>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_aff7bd8f55d8fcd1de11a905bcd58cb4.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_43f969dfc5a04144caccb634634e9038.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d110>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f8a4951c409a75b7f9799266eed3b587.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da2390>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_32dd4c24c06fbb947ca92f07fe261046.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73769671-7e9b-54b8-938d-d860d18b377e
2026-04-27 08:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73769671-7e9b-54b8-938d-d860d18b377e, skipping ID generation
2026-04-27 08:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73769671-7e9b-54b8-938d-d860d18b377e with scrape type 1
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73769671-7e9b-54b8-938d-d860d18b377e sending to next pipeline
2026-04-27 08:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73769671-7e9b-54b8-938d-d860d18b377e, identifier: RA50957
2026-04-27 08:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73769671-7e9b-54b8-938d-d860d18b377e with identifier: RA50957
2026-04-27 08:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73769671-7e9b-54b8-938d-d860d18b377e with identifier: RA50957
2026-04-27 08:03:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73769671-7e9b-54b8-938d-d860d18b377e with identifier: RA50957 to the API
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_32dd4c24c06fbb947ca92f07fe261046.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Dortmund',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:37:58Z',
 'fuel_type': 'petrol',
 'id': '73769671-7e9b-54b8-938d-d860d18b377e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA50957',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 177043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_32dd4c24c06fbb947ca92f07fe261046.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_aff7bd8f55d8fcd1de11a905bcd58cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_bd9bd23e0086195762deb63a62be070a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_175536c348741c736df5ac0b457754bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_91ae80ce17b5fb4dc44fb83f70a484d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_4c28d701a219c142a6910b2a844b7707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_a89c2766881c2207bb3e317045dbea6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_80a9c2a734dd17ea96d66479ae843128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_8b74a2fc5a6aef33cdeb51d99ca86f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73769671-7e9b-54b8-938d-d860d18b377e/73769671-7e9b-54b8-938d-d860d18b377e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/259786bf1fb02d8e5f865cb7ef55e2f4/pa/RA50957_f1e4d45f0c7fa394ffc934cc8c1d9b1a.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2013-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-04-27 08:03:00 [auto1.de] INFO: Saving data for RA50957: {'created_time': 1777276980.544001, 'last_price_update_time': 1777276980.544011, 'has_photos': True, 'auction_closing_time': 1777390678.0}
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f087d94d899f192f4fd9105a4a5af11d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_b7ba357a90f54300419fe017228566a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b81690>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_43f969dfc5a04144caccb634634e9038.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_77fd3de1414539c9ecf1a6c8fd99f9fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026ecd0>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f087d94d899f192f4fd9105a4a5af11d.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eff3610>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_b7ba357a90f54300419fe017228566a2.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a610>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_77fd3de1414539c9ecf1a6c8fd99f9fc.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0
2026-04-27 08:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0, skipping ID generation
2026-04-27 08:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with scrape type 1
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 sending to next pipeline
2026-04-27 08:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0, identifier: LA33826
2026-04-27 08:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-04-27 08:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-04-27 08:03:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826 to the API
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_77fd3de1414539c9ecf1a6c8fd99f9fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'city': 'Ketzin',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:49:31Z',
 'fuel_type': 'diesel',
 'id': 'd687415a-bbdf-5e3b-8e67-3bf0e845d9e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA33826',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 57971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_77fd3de1414539c9ecf1a6c8fd99f9fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_b7ba357a90f54300419fe017228566a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f087d94d899f192f4fd9105a4a5af11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_43f969dfc5a04144caccb634634e9038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_f8a4951c409a75b7f9799266eed3b587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_42831da82d508dbf56b0682eb993e8a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_4228c31169382f54a4d89bc84a7cc66d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_6087a219ff560708baca19f4250db855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_d53fa810733c330b41893550a409eb8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d687415a-bbdf-5e3b-8e67-3bf0e845d9e0/d687415a-bbdf-5e3b-8e67-3bf0e845d9e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9c/389cbdf78c744db097f72424f052696a/pa/LA33826_8949ca471ab6bf99b5140171868b33eb.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2018-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2018}
2026-04-27 08:03:01 [auto1.de] INFO: Saving data for LA33826: {'created_time': 1777276981.27382, 'last_price_update_time': 1777276981.273829, 'has_photos': True, 'auction_closing_time': 1777391371.0}
2026-04-27 08:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE38589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB11213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET24153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.817(s), this was the 1st time calling it.
2026-04-27 08:03:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.4974728533719395 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV91835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD54175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB07768> (referer: https://www.auto1.com/v1/car-details-view/PB07768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 012a1824-533f-5f1f-9100-f428b55b45f6 with identifier: PB07768
2026-04-27 08:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 012a1824-533f-5f1f-9100-f428b55b45f6 with scrape type 1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_cae9d0521939203bb1364cc5a52a57ca.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6b68792f6d832e6fb6fe4ce7cb7a645a.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_4d9f5056eb74f12bdf0df48f2bf7911c.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_ffe5f3a515fb73b8f47d344f4765a64d.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6f9102bc086c530c37ce26314df351c6.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_305fe8438c1e53861dc98404e82a5193.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_d66dc3054a78315b51b1aa3558bbc274.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_0771d0af01337fa99ce5f42a444537f3.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_264d6e670be9655daf5edb4c4d185cf7.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_62e73d499487eed6f19a0c1052dea7c7.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE66313> (referer: https://www.auto1.com/v1/car-details-view/UE66313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_62e73d499487eed6f19a0c1052dea7c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 730691ac-869d-5108-814f-62b9210dc24d with identifier: UE66313
2026-04-27 08:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 730691ac-869d-5108-814f-62b9210dc24d with scrape type 1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_1fbc5f573716f8aec240d93bae9d4ba1.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_7abe5b06b20b254fb0d0af79ea96678e.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_128cc06df81dc870b9aeb8329406d827.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_04619437875c20c64712d2524e8d4a34.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_f56ebde8be2cbee01413e21a1dbab1a3.jpg not downloaded yet
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e434d0>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_62e73d499487eed6f19a0c1052dea7c7.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_025dfe953e33a8c3a1fcd9b063ded59b.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_264d6e670be9655daf5edb4c4d185cf7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_b3fab4e11ee6e89c7a0f479de7b19b71.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_4c979c2fa1861c91ffa9f89bc0eb7de4.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_9cdb793a70a966d2b5f5ab2dc076dd12.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_255795be4791e875d5872ae73d6d87dc.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_025dfe953e33a8c3a1fcd9b063ded59b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee1190>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_264d6e670be9655daf5edb4c4d185cf7.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_255795be4791e875d5872ae73d6d87dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289410>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_025dfe953e33a8c3a1fcd9b063ded59b.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6950>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_255795be4791e875d5872ae73d6d87dc.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_9cdb793a70a966d2b5f5ab2dc076dd12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_4c979c2fa1861c91ffa9f89bc0eb7de4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b412d0>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_9cdb793a70a966d2b5f5ab2dc076dd12.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_b3fab4e11ee6e89c7a0f479de7b19b71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015bf50>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_4c979c2fa1861c91ffa9f89bc0eb7de4.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189250>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_b3fab4e11ee6e89c7a0f479de7b19b71.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_f56ebde8be2cbee01413e21a1dbab1a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_04619437875c20c64712d2524e8d4a34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_128cc06df81dc870b9aeb8329406d827.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300521d0>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_f56ebde8be2cbee01413e21a1dbab1a3.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee1750>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_04619437875c20c64712d2524e8d4a34.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b4d0>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_128cc06df81dc870b9aeb8329406d827.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_7abe5b06b20b254fb0d0af79ea96678e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA60323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_1fbc5f573716f8aec240d93bae9d4ba1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_0771d0af01337fa99ce5f42a444537f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db5850>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_7abe5b06b20b254fb0d0af79ea96678e.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1e750>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_1fbc5f573716f8aec240d93bae9d4ba1.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 730691ac-869d-5108-814f-62b9210dc24d
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 730691ac-869d-5108-814f-62b9210dc24d, skipping ID generation
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 730691ac-869d-5108-814f-62b9210dc24d with scrape type 1
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 730691ac-869d-5108-814f-62b9210dc24d sending to next pipeline
2026-04-27 08:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 730691ac-869d-5108-814f-62b9210dc24d, identifier: UE66313
2026-04-27 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 730691ac-869d-5108-814f-62b9210dc24d with identifier: UE66313
2026-04-27 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 730691ac-869d-5108-814f-62b9210dc24d with identifier: UE66313
2026-04-27 08:03:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 730691ac-869d-5108-814f-62b9210dc24d with identifier: UE66313 to the API
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_1fbc5f573716f8aec240d93bae9d4ba1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'city': 'Buch',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-04-28T15:17:09Z',
 'fuel_type': 'diesel',
 'id': '730691ac-869d-5108-814f-62b9210dc24d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE66313',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 127482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_1fbc5f573716f8aec240d93bae9d4ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_7abe5b06b20b254fb0d0af79ea96678e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_128cc06df81dc870b9aeb8329406d827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_04619437875c20c64712d2524e8d4a34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_f56ebde8be2cbee01413e21a1dbab1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_025dfe953e33a8c3a1fcd9b063ded59b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_b3fab4e11ee6e89c7a0f479de7b19b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_4c979c2fa1861c91ffa9f89bc0eb7de4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_9cdb793a70a966d2b5f5ab2dc076dd12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_730691ac-869d-5108-814f-62b9210dc24d/730691ac-869d-5108-814f-62b9210dc24d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/88/56881493df0c3facbb3647ccaf0f2747/pa/UE66313_255795be4791e875d5872ae73d6d87dc.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2018-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-04-27 08:03:28 [auto1.de] INFO: Saving data for UE66313: {'created_time': 1777277008.258969, 'last_price_update_time': 1777277008.258982, 'has_photos': True, 'auction_closing_time': 1777389429.0}
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_d66dc3054a78315b51b1aa3558bbc274.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_305fe8438c1e53861dc98404e82a5193.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67910>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_0771d0af01337fa99ce5f42a444537f3.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN04464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41a90>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_d66dc3054a78315b51b1aa3558bbc274.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf19d0>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_305fe8438c1e53861dc98404e82a5193.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6f9102bc086c530c37ce26314df351c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_ffe5f3a515fb73b8f47d344f4765a64d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40890>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6f9102bc086c530c37ce26314df351c6.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5390>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_ffe5f3a515fb73b8f47d344f4765a64d.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_4d9f5056eb74f12bdf0df48f2bf7911c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6b68792f6d832e6fb6fe4ce7cb7a645a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee8690>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_4d9f5056eb74f12bdf0df48f2bf7911c.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_cae9d0521939203bb1364cc5a52a57ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4890>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6b68792f6d832e6fb6fe4ce7cb7a645a.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a290>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_cae9d0521939203bb1364cc5a52a57ca.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 012a1824-533f-5f1f-9100-f428b55b45f6
2026-04-27 08:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 012a1824-533f-5f1f-9100-f428b55b45f6, skipping ID generation
2026-04-27 08:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 012a1824-533f-5f1f-9100-f428b55b45f6 with scrape type 1
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 012a1824-533f-5f1f-9100-f428b55b45f6 sending to next pipeline
2026-04-27 08:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 012a1824-533f-5f1f-9100-f428b55b45f6, identifier: PB07768
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF38506> (referer: https://www.auto1.com/v1/car-details-view/SF38506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 012a1824-533f-5f1f-9100-f428b55b45f6 with identifier: PB07768
2026-04-27 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 012a1824-533f-5f1f-9100-f428b55b45f6 with identifier: PB07768
2026-04-27 08:03:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 012a1824-533f-5f1f-9100-f428b55b45f6 with identifier: PB07768 to the API
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_cae9d0521939203bb1364cc5a52a57ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Erbach',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-04-28T15:29:10Z',
 'fuel_type': 'petrol',
 'id': '012a1824-533f-5f1f-9100-f428b55b45f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB07768',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 92477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_cae9d0521939203bb1364cc5a52a57ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6b68792f6d832e6fb6fe4ce7cb7a645a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_4d9f5056eb74f12bdf0df48f2bf7911c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_ffe5f3a515fb73b8f47d344f4765a64d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_6f9102bc086c530c37ce26314df351c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_305fe8438c1e53861dc98404e82a5193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_d66dc3054a78315b51b1aa3558bbc274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_0771d0af01337fa99ce5f42a444537f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_264d6e670be9655daf5edb4c4d185cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_012a1824-533f-5f1f-9100-f428b55b45f6/012a1824-533f-5f1f-9100-f428b55b45f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/aa/1aaaacad7ef5b5aece808335dd7add46/pa/PB07768_62e73d499487eed6f19a0c1052dea7c7.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2016-05-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2016}
2026-04-27 08:03:29 [auto1.de] INFO: Saving data for PB07768: {'created_time': 1777277009.562623, 'last_price_update_time': 1777277009.562635, 'has_photos': True, 'auction_closing_time': 1777390150.0}
2026-04-27 08:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU23816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6471d6b8-bed4-5004-9802-7864a41c3e72 with identifier: SF38506
2026-04-27 08:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6471d6b8-bed4-5004-9802-7864a41c3e72 with scrape type 1
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_355b9bc95d931cae52e25e28c9ecc60e.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_8b97d9ce63f240b2142b9047bb213f0c.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e2f82d6140c4a6ef9d71583d03177ba0.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_c7a23dfd953669658c54bca16ddbc550.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_074d502f584b4ab56a24de6f82cb0054.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_896ec7e36ec35b1f4de596a6559c4024.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_daea96c80570e5079f2e74642ebfc3bb.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e697c2a16d420d7138b6c5979f05f276.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e9f54df72a273d14cea24fcb274a6511.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_1d0ec6289236f190ea544081f8ab44bd.jpg not downloaded yet
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE38589> (referer: https://www.auto1.com/v1/car-details-view/CE38589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_1d0ec6289236f190ea544081f8ab44bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0694e2c-3c09-53df-bf92-3b96b52d6159 with identifier: CE38589
2026-04-27 08:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0694e2c-3c09-53df-bf92-3b96b52d6159 with scrape type 1
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_58d14b3b95da36a3b092c88a2f68b64c.jpg not downloaded yet
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_da315f04a07d1f5171545c4f9de8051e.jpg not downloaded yet
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e9f54df72a273d14cea24fcb274a6511.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_3a1f363e30b58700cc808097c124e8cb.jpg not downloaded yet
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_b83b9611b96cd47be34769e05aa1a8fa.jpg not downloaded yet
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_8cb069301d2d2aa3ba7d2d0c5c8dca06.jpg not downloaded yet
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da34d0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_1d0ec6289236f190ea544081f8ab44bd.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_d134297b75683bf19f994f41cb3c1a37.jpg not downloaded yet
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_58d14b3b95da36a3b092c88a2f68b64c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_eada6f75b9edde79adeb876242c78f64.jpg not downloaded yet
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db5610>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e9f54df72a273d14cea24fcb274a6511.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_2f672e438740571ca83536438a9173a3.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_86c207c9ad5b8f0faba10f98a7c498ef.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_e85335e97143ab6f0da2e03ba58a0e34.jpg not downloaded yet
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0ad10>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_58d14b3b95da36a3b092c88a2f68b64c.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB11213> (referer: https://www.auto1.com/v1/car-details-view/MB11213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with identifier: MB11213
2026-04-27 08:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with scrape type 1
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ce5892f849acc83e935356ce7c89668b.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ea41d792c28adafa13fd05686c91db36.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_08014d00193a177992ca7c2628e02400.jpg not downloaded yet
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_d134297b75683bf19f994f41cb3c1a37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_dd8504740c5fb1577867b0c14ff3f891.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_be6cffb0975b4be4baac0890c20e50db.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_b10e022825f92efd26275a8cdceb8062.jpg not downloaded yet
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_e85335e97143ab6f0da2e03ba58a0e34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ba8a68e914e3038b58109efd2b38d9e8.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_c10b68541d35630e5873f77246b9d850.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_4c7753696dfd4f6e85cf74f21a0542c1.jpg not downloaded yet
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_3584bdaaa2a91a4ffdaee6f5a9d5f9f5.jpg not downloaded yet
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051ad0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_d134297b75683bf19f994f41cb3c1a37.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026d4d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_e85335e97143ab6f0da2e03ba58a0e34.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_08014d00193a177992ca7c2628e02400.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_b10e022825f92efd26275a8cdceb8062.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a58cd0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_08014d00193a177992ca7c2628e02400.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026c7d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_b10e022825f92efd26275a8cdceb8062.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_4c7753696dfd4f6e85cf74f21a0542c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_3584bdaaa2a91a4ffdaee6f5a9d5f9f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a72650>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_4c7753696dfd4f6e85cf74f21a0542c1.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_c10b68541d35630e5873f77246b9d850.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ba8a68e914e3038b58109efd2b38d9e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1a90>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_3584bdaaa2a91a4ffdaee6f5a9d5f9f5.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1ee90>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_c10b68541d35630e5873f77246b9d850.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6c7d0>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ba8a68e914e3038b58109efd2b38d9e8.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_be6cffb0975b4be4baac0890c20e50db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_dd8504740c5fb1577867b0c14ff3f891.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ce5892f849acc83e935356ce7c89668b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_86c207c9ad5b8f0faba10f98a7c498ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43090>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_be6cffb0975b4be4baac0890c20e50db.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41b50>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_dd8504740c5fb1577867b0c14ff3f891.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_2f672e438740571ca83536438a9173a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ea41d792c28adafa13fd05686c91db36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301892d0>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ce5892f849acc83e935356ce7c89668b.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf09d0>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_86c207c9ad5b8f0faba10f98a7c498ef.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG99324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad490>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_2f672e438740571ca83536438a9173a3.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30058590>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ea41d792c28adafa13fd05686c91db36.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd
2026-04-27 08:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd, skipping ID generation
2026-04-27 08:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with scrape type 1
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b8acbf9-807c-5cfb-a100-47e96eedbbbd sending to next pipeline
2026-04-27 08:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd, identifier: MB11213
2026-04-27 08:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with identifier: MB11213
2026-04-27 08:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with identifier: MB11213
2026-04-27 08:03:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b8acbf9-807c-5cfb-a100-47e96eedbbbd with identifier: MB11213 to the API
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ea41d792c28adafa13fd05686c91db36.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Germersheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:55:03Z',
 'fuel_type': 'petrol',
 'id': '5b8acbf9-807c-5cfb-a100-47e96eedbbbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB11213',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Audi',
 'model': 'A1',
 'odometer': 164909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ce5892f849acc83e935356ce7c89668b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ea41d792c28adafa13fd05686c91db36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_08014d00193a177992ca7c2628e02400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_dd8504740c5fb1577867b0c14ff3f891.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_be6cffb0975b4be4baac0890c20e50db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_b10e022825f92efd26275a8cdceb8062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_ba8a68e914e3038b58109efd2b38d9e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_c10b68541d35630e5873f77246b9d850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_4c7753696dfd4f6e85cf74f21a0542c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b8acbf9-807c-5cfb-a100-47e96eedbbbd/5b8acbf9-807c-5cfb-a100-47e96eedbbbd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/28/202815885d4533d86ea379a878ddb1e6/pa/MB11213_3584bdaaa2a91a4ffdaee6f5a9d5f9f5.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2011-08-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-04-27 08:03:33 [auto1.de] INFO: Saving data for MB11213: {'created_time': 1777277013.196884, 'last_price_update_time': 1777277013.196895, 'has_photos': True, 'auction_closing_time': 1777391703.0}
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_eada6f75b9edde79adeb876242c78f64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_b83b9611b96cd47be34769e05aa1a8fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_8cb069301d2d2aa3ba7d2d0c5c8dca06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e697c2a16d420d7138b6c5979f05f276.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159110>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_eada6f75b9edde79adeb876242c78f64.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35210>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_b83b9611b96cd47be34769e05aa1a8fa.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028e890>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_8cb069301d2d2aa3ba7d2d0c5c8dca06.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_da315f04a07d1f5171545c4f9de8051e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eab20d0>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e697c2a16d420d7138b6c5979f05f276.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_3a1f363e30b58700cc808097c124e8cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4c750>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_da315f04a07d1f5171545c4f9de8051e.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2d410>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_3a1f363e30b58700cc808097c124e8cb.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0694e2c-3c09-53df-bf92-3b96b52d6159
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0694e2c-3c09-53df-bf92-3b96b52d6159, skipping ID generation
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0694e2c-3c09-53df-bf92-3b96b52d6159 with scrape type 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0694e2c-3c09-53df-bf92-3b96b52d6159 sending to next pipeline
2026-04-27 08:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0694e2c-3c09-53df-bf92-3b96b52d6159, identifier: CE38589
2026-04-27 08:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0694e2c-3c09-53df-bf92-3b96b52d6159 with identifier: CE38589
2026-04-27 08:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0694e2c-3c09-53df-bf92-3b96b52d6159 with identifier: CE38589
2026-04-27 08:03:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0694e2c-3c09-53df-bf92-3b96b52d6159 with identifier: CE38589 to the API
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_3a1f363e30b58700cc808097c124e8cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'city': 'Erbach',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:03:31Z',
 'fuel_type': 'petrol',
 'id': 'c0694e2c-3c09-53df-bf92-3b96b52d6159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE38589',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 165251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_58d14b3b95da36a3b092c88a2f68b64c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_da315f04a07d1f5171545c4f9de8051e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_3a1f363e30b58700cc808097c124e8cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_b83b9611b96cd47be34769e05aa1a8fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_8cb069301d2d2aa3ba7d2d0c5c8dca06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_d134297b75683bf19f994f41cb3c1a37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_eada6f75b9edde79adeb876242c78f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_2f672e438740571ca83536438a9173a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_86c207c9ad5b8f0faba10f98a7c498ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0694e2c-3c09-53df-bf92-3b96b52d6159/c0694e2c-3c09-53df-bf92-3b96b52d6159_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/9b/f19b903ffcaff80244f41bb976dcf3f4/pa/CE38589_e85335e97143ab6f0da2e03ba58a0e34.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2010-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-04-27 08:03:34 [auto1.de] INFO: Saving data for CE38589: {'created_time': 1777277014.079205, 'last_price_update_time': 1777277014.079218, 'has_photos': True, 'auction_closing_time': 1777388611.0}
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_daea96c80570e5079f2e74642ebfc3bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a510>
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_daea96c80570e5079f2e74642ebfc3bb.jpg saved to cache
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_896ec7e36ec35b1f4de596a6559c4024.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fa590>
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_896ec7e36ec35b1f4de596a6559c4024.jpg saved to cache
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_074d502f584b4ab56a24de6f82cb0054.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30288f90>
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_074d502f584b4ab56a24de6f82cb0054.jpg saved to cache
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_c7a23dfd953669658c54bca16ddbc550.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051b10>
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_c7a23dfd953669658c54bca16ddbc550.jpg saved to cache
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e2f82d6140c4a6ef9d71583d03177ba0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_8b97d9ce63f240b2142b9047bb213f0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_355b9bc95d931cae52e25e28c9ecc60e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028bf50>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e2f82d6140c4a6ef9d71583d03177ba0.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300516d0>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_8b97d9ce63f240b2142b9047bb213f0c.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289c90>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_355b9bc95d931cae52e25e28c9ecc60e.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6471d6b8-bed4-5004-9802-7864a41c3e72
2026-04-27 08:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6471d6b8-bed4-5004-9802-7864a41c3e72, skipping ID generation
2026-04-27 08:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6471d6b8-bed4-5004-9802-7864a41c3e72 with scrape type 1
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6471d6b8-bed4-5004-9802-7864a41c3e72 sending to next pipeline
2026-04-27 08:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6471d6b8-bed4-5004-9802-7864a41c3e72, identifier: SF38506
2026-04-27 08:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6471d6b8-bed4-5004-9802-7864a41c3e72 with identifier: SF38506
2026-04-27 08:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6471d6b8-bed4-5004-9802-7864a41c3e72 with identifier: SF38506
2026-04-27 08:03:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6471d6b8-bed4-5004-9802-7864a41c3e72 with identifier: SF38506 to the API
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_355b9bc95d931cae52e25e28c9ecc60e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Buch',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:34:56Z',
 'fuel_type': 'diesel',
 'id': '6471d6b8-bed4-5004-9802-7864a41c3e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF38506',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 275186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_355b9bc95d931cae52e25e28c9ecc60e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_8b97d9ce63f240b2142b9047bb213f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e2f82d6140c4a6ef9d71583d03177ba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_c7a23dfd953669658c54bca16ddbc550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_074d502f584b4ab56a24de6f82cb0054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_896ec7e36ec35b1f4de596a6559c4024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_daea96c80570e5079f2e74642ebfc3bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e697c2a16d420d7138b6c5979f05f276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_e9f54df72a273d14cea24fcb274a6511.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6471d6b8-bed4-5004-9802-7864a41c3e72/6471d6b8-bed4-5004-9802-7864a41c3e72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5b/cc5b9e22f754156b3d3037a2db3beead/pa/SF38506_1d0ec6289236f190ea544081f8ab44bd.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI 4Sports BlueMotion Tech',
 'transmission': 'manual',
 'trim': '4Sports BlueMotion Tech',
 'year': 2014}
2026-04-27 08:03:35 [auto1.de] INFO: Saving data for SF38506: {'created_time': 1777277015.632263, 'last_price_update_time': 1777277015.632277, 'has_photos': True, 'auction_closing_time': 1777390496.0}
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET24153> (referer: https://www.auto1.com/v1/car-details-view/ET24153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV91835> (referer: https://www.auto1.com/v1/car-details-view/AV91835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with identifier: ET24153
2026-04-27 08:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with scrape type 1
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_9d915d74ffa379bfef1c395d53cd65f4.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_3b6815f9b1d360479214ecda5141e134.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with identifier: AV91835
2026-04-27 08:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with scrape type 1
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_d6914e0453ffa58aa9331438c310e246.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_53fcdb67eea7fc854a7c0654d8e593c1.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_790ec5f9ef8b1746e84d6f0b6d4f0320.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_bd01f97f5b68b2bedaf2491ac1bf44e8.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_422239608b63c6011d2c69609869c452.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_2fdcf30dbf651336a07ebf5db37b33d4.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_19c1bd7122b7c2be738ab462087ff163.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_7bb6f2f4914e4901212e7b552c8ba9ce.jpg not downloaded yet
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_e6ee5bb48f3361ce2e5c1858b9ff1835.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_b630ba827e1c5f7d8c6b2486e402d7ee.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_898c52829dd1c5da9dc12c4997e330a2.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_177b8335cf738b96472710c9a2808623.jpg not downloaded yet
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_4af3a7114dd753299218ec84a257b4d2.jpg not downloaded yet
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD54175> (referer: https://www.auto1.com/v1/car-details-view/PD54175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with identifier: PD54175
2026-04-27 08:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with scrape type 1
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_3b7ded9fae2f70a5f9d6e8e8b19689d7.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_2a820908590b3838a9dc7adbbc1c4116.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_ab1463b89d318a19cb33386aa37ef987.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_e278f7c91b092ca8be145453df30851e.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_c97563db3263bfb6809053a857f20f07.jpg not downloaded yet
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_4af3a7114dd753299218ec84a257b4d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_687c8c5f40afcea87582f1697debd64f.jpg not downloaded yet
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_cfe7df44c00950c1ac710e6b8eea4a16.jpg not downloaded yet
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_11810cccaa408720cca19b7b20a7c530.jpg not downloaded yet
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_bf70b4fb919e8b2cc6ffbd5d6c9e936c.jpg not downloaded yet
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_f585d164a79a25638f9e9235da533218.jpg not downloaded yet
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003e190>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_4af3a7114dd753299218ec84a257b4d2.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_c97563db3263bfb6809053a857f20f07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c04d0>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_c97563db3263bfb6809053a857f20f07.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.510(s), this was the 1st time calling it.
2026-04-27 08:03:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.285152814169222 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_f585d164a79a25638f9e9235da533218.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a8750>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_f585d164a79a25638f9e9235da533218.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_bf70b4fb919e8b2cc6ffbd5d6c9e936c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ce90>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_bf70b4fb919e8b2cc6ffbd5d6c9e936c.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_11810cccaa408720cca19b7b20a7c530.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017db10>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_11810cccaa408720cca19b7b20a7c530.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_cfe7df44c00950c1ac710e6b8eea4a16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6c950>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_cfe7df44c00950c1ac710e6b8eea4a16.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_687c8c5f40afcea87582f1697debd64f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017c550>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_687c8c5f40afcea87582f1697debd64f.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_e278f7c91b092ca8be145453df30851e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2fd90>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_e278f7c91b092ca8be145453df30851e.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_ab1463b89d318a19cb33386aa37ef987.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcb350>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_ab1463b89d318a19cb33386aa37ef987.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_2a820908590b3838a9dc7adbbc1c4116.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_3b7ded9fae2f70a5f9d6e8e8b19689d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015bf50>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_2a820908590b3838a9dc7adbbc1c4116.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82fd0>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_3b7ded9fae2f70a5f9d6e8e8b19689d7.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9
2026-04-27 08:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9, skipping ID generation
2026-04-27 08:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with scrape type 1
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 sending to next pipeline
2026-04-27 08:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9, identifier: PD54175
2026-04-27 08:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with identifier: PD54175
2026-04-27 08:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with identifier: PD54175
2026-04-27 08:03:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e7f97e9-24e4-5432-8e48-98f63df5cbd9 with identifier: PD54175 to the API
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_3b7ded9fae2f70a5f9d6e8e8b19689d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'city': 'Ketzin',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-04-28T15:03:30Z',
 'fuel_type': 'petrol',
 'id': '1e7f97e9-24e4-5432-8e48-98f63df5cbd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD54175',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 27240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_3b7ded9fae2f70a5f9d6e8e8b19689d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_2a820908590b3838a9dc7adbbc1c4116.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_ab1463b89d318a19cb33386aa37ef987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_e278f7c91b092ca8be145453df30851e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_c97563db3263bfb6809053a857f20f07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_687c8c5f40afcea87582f1697debd64f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_cfe7df44c00950c1ac710e6b8eea4a16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_11810cccaa408720cca19b7b20a7c530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_bf70b4fb919e8b2cc6ffbd5d6c9e936c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e7f97e9-24e4-5432-8e48-98f63df5cbd9/1e7f97e9-24e4-5432-8e48-98f63df5cbd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b9/d9b906ec7d830e4a1d64bd38a1e09f1c/pa/PD54175_f585d164a79a25638f9e9235da533218.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-04-27 08:03:40 [auto1.de] INFO: Saving data for PD54175: {'created_time': 1777277020.581278, 'last_price_update_time': 1777277020.581288, 'has_photos': True, 'auction_closing_time': 1777388610.0}
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_177b8335cf738b96472710c9a2808623.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.784(s), this was the 1st time calling it.
2026-04-27 08:03:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.441105631550787 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a8750>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_177b8335cf738b96472710c9a2808623.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_898c52829dd1c5da9dc12c4997e330a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208a450>
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_898c52829dd1c5da9dc12c4997e330a2.jpg saved to cache
2026-04-27 08:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_b630ba827e1c5f7d8c6b2486e402d7ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189e10>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_b630ba827e1c5f7d8c6b2486e402d7ee.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_e6ee5bb48f3361ce2e5c1858b9ff1835.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c350>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_e6ee5bb48f3361ce2e5c1858b9ff1835.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_7bb6f2f4914e4901212e7b552c8ba9ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30189910>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_7bb6f2f4914e4901212e7b552c8ba9ce.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_19c1bd7122b7c2be738ab462087ff163.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026f510>
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_19c1bd7122b7c2be738ab462087ff163.jpg saved to cache
2026-04-27 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_2fdcf30dbf651336a07ebf5db37b33d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0b590>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_2fdcf30dbf651336a07ebf5db37b33d4.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_422239608b63c6011d2c69609869c452.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0c8d0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_422239608b63c6011d2c69609869c452.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_bd01f97f5b68b2bedaf2491ac1bf44e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018b4d0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_bd01f97f5b68b2bedaf2491ac1bf44e8.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_790ec5f9ef8b1746e84d6f0b6d4f0320.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6bc10>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_790ec5f9ef8b1746e84d6f0b6d4f0320.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_53fcdb67eea7fc854a7c0654d8e593c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_d6914e0453ffa58aa9331438c310e246.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159290>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_53fcdb67eea7fc854a7c0654d8e593c1.jpg saved to cache
2026-04-27 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04dd0>
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_d6914e0453ffa58aa9331438c310e246.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8
2026-04-27 08:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8, skipping ID generation
2026-04-27 08:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with scrape type 1
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 sending to next pipeline
2026-04-27 08:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8, identifier: AV91835
2026-04-27 08:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with identifier: AV91835
2026-04-27 08:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with identifier: AV91835
2026-04-27 08:03:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8 with identifier: AV91835 to the API
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_d6914e0453ffa58aa9331438c310e246.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Germersheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:15:58Z',
 'fuel_type': 'petrol',
 'id': 'a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV91835',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 203327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_d6914e0453ffa58aa9331438c310e246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_790ec5f9ef8b1746e84d6f0b6d4f0320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_422239608b63c6011d2c69609869c452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_19c1bd7122b7c2be738ab462087ff163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_7bb6f2f4914e4901212e7b552c8ba9ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_e6ee5bb48f3361ce2e5c1858b9ff1835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_b630ba827e1c5f7d8c6b2486e402d7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_898c52829dd1c5da9dc12c4997e330a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_177b8335cf738b96472710c9a2808623.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8/a10df8ba-ae59-51cb-a8c3-3e1f17a05ce8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/6d/0b6d5d8b9d22c71a75d2aad4c7a1b3f9/pa/AV91835_4af3a7114dd753299218ec84a257b4d2.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2013-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-04-27 08:03:43 [auto1.de] INFO: Saving data for AV91835: {'created_time': 1777277023.598848, 'last_price_update_time': 1777277023.598858, 'has_photos': True, 'auction_closing_time': 1777389358.0}
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_3b6815f9b1d360479214ecda5141e134.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d620d0>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_3b6815f9b1d360479214ecda5141e134.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_9d915d74ffa379bfef1c395d53cd65f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:43 [scrapy.extensions.logstats] INFO: Crawled 504 pages (at 27 pages/min), scraped 217 items (at 14 items/min)
2026-04-27 08:03:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6cd90>
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_9d915d74ffa379bfef1c395d53cd65f4.jpg saved to cache
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66
2026-04-27 08:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66, skipping ID generation
2026-04-27 08:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with scrape type 1
2026-04-27 08:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 sending to next pipeline
2026-04-27 08:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66, identifier: ET24153
2026-04-27 08:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with identifier: ET24153
2026-04-27 08:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with identifier: ET24153
2026-04-27 08:03:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2022b3f3-e20e-5f5c-9c63-d6ebcffccc66 with identifier: ET24153 to the API
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_9d915d74ffa379bfef1c395d53cd65f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:01:03Z',
 'fuel_type': 'petrol',
 'id': '2022b3f3-e20e-5f5c-9c63-d6ebcffccc66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET24153',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 139775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_9d915d74ffa379bfef1c395d53cd65f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_3b6815f9b1d360479214ecda5141e134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_53fcdb67eea7fc854a7c0654d8e593c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_bd01f97f5b68b2bedaf2491ac1bf44e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2022b3f3-e20e-5f5c-9c63-d6ebcffccc66/2022b3f3-e20e-5f5c-9c63-d6ebcffccc66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1fa66daccabcbab4422c88668418e2f/pa/ET24153_2fdcf30dbf651336a07ebf5db37b33d4.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-04-27 08:03:44 [auto1.de] INFO: Saving data for ET24153: {'created_time': 1777277024.328055, 'last_price_update_time': 1777277024.328064, 'has_photos': True, 'auction_closing_time': 1777388463.0}
2026-04-27 08:03:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.106(s), this was the 1st time calling it.
2026-04-27 08:03:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.920940630002438 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.139(s), this was the 1st time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8470548917653336 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD28185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_df8d4dfd4d3c988fdf0425d0415ba75e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b41590>
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_df8d4dfd4d3c988fdf0425d0415ba75e.jpg saved to cache
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_9f5e70c4acddac4dfec88d1c7c8c4e26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcb490>
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_9f5e70c4acddac4dfec88d1c7c8c4e26.jpg saved to cache
2026-04-27 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC54286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_d11751feab022d32cda586406f233ecf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018a910>
2026-04-27 08:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_d11751feab022d32cda586406f233ecf.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF78071> (referer: https://www.auto1.com/v1/car-details-view/UF78071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_e5ac1c7d4076a29e06a69ecf7891c2a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7912941-4712-5304-9865-091d5879cbbe with identifier: UF78071
2026-04-27 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7912941-4712-5304-9865-091d5879cbbe with scrape type 1
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a000c845bcadb0f8a0f439840dcde41f.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_fce98b6000cb58a8f0f0ea1fa0be17ab.jpg not downloaded yet
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM03652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a9d7150b316fe59be5e3e6adce487746.jpg not downloaded yet
2026-04-27 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_71d52394b1197cb6b09c8ae449e619a1.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_7f2a53eff46aaa4712a8d3651a5747fe.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_ac60d88ff1e91cfa6fde539ec0afa353.jpg not downloaded yet
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c3b50>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_e5ac1c7d4076a29e06a69ecf7891c2a8.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_c0d99982b5b1133be4499654e46fbf1c.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_764c87ec2cc8aab7bf7f280f1d04dd90.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_521ce0c5cb86ddeca38a489906125182.jpg not downloaded yet
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_e4b2fd658f6c6da7ebdec968d5074d88.jpg not downloaded yet
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_3a2b6f0241b2492009e00e8b6521df34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_fce98b6000cb58a8f0f0ea1fa0be17ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cfcd0>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_3a2b6f0241b2492009e00e8b6521df34.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6b410>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_fce98b6000cb58a8f0f0ea1fa0be17ab.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_e4b2fd658f6c6da7ebdec968d5074d88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a9910>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_e4b2fd658f6c6da7ebdec968d5074d88.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_521ce0c5cb86ddeca38a489906125182.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cfd90>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_521ce0c5cb86ddeca38a489906125182.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_764c87ec2cc8aab7bf7f280f1d04dd90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fae50>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_764c87ec2cc8aab7bf7f280f1d04dd90.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_c0d99982b5b1133be4499654e46fbf1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG99324> (referer: https://www.auto1.com/v1/car-details-view/YG99324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30063290>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_c0d99982b5b1133be4499654e46fbf1c.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8143821-a277-5411-beee-c39c78f67533 with identifier: YG99324
2026-04-27 08:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8143821-a277-5411-beee-c39c78f67533 with scrape type 1
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_76672acf0e0ad62afab7fa8ab880c387.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_26d5178f8906865d17ad1404a60e3d77.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_a288a21467ac2b9f223d7f752b54297b.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_ac60d88ff1e91cfa6fde539ec0afa353.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_d73e16c456ca55f3dcfbee7281926ae5.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_7f2a53eff46aaa4712a8d3651a5747fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_e065931f0ad35a897681865855a9be37.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_ade7576caf1a30ddb92e8cf712792645.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_6dde99a74ac1bb9f86c02d547ee07b47.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_c2ef1281a1868d8ab69c1d34b509a179.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_65db953ea354a677539ce5af82a1275b.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300515d0>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_ac60d88ff1e91cfa6fde539ec0afa353.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6a590>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_7f2a53eff46aaa4712a8d3651a5747fe.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_242cbc15fe64adfd85eaf64544dd9e01.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_a288a21467ac2b9f223d7f752b54297b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_d73e16c456ca55f3dcfbee7281926ae5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaee50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_a288a21467ac2b9f223d7f752b54297b.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_65db953ea354a677539ce5af82a1275b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014e050>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_d73e16c456ca55f3dcfbee7281926ae5.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_242cbc15fe64adfd85eaf64544dd9e01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f50890>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_65db953ea354a677539ce5af82a1275b.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eac2d0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_242cbc15fe64adfd85eaf64544dd9e01.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_c2ef1281a1868d8ab69c1d34b509a179.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_6dde99a74ac1bb9f86c02d547ee07b47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS15824> (referer: https://www.auto1.com/v1/car-details-view/VS15824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.215(s), this was the 1st time calling it.
2026-04-27 08:03:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.96782448783323 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014fb50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_c2ef1281a1868d8ab69c1d34b509a179.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_26d5178f8906865d17ad1404a60e3d77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_ade7576caf1a30ddb92e8cf712792645.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_e065931f0ad35a897681865855a9be37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8b090>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_6dde99a74ac1bb9f86c02d547ee07b47.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1777e40b-7358-5150-b810-90388bb40a2b with identifier: VS15824
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1777e40b-7358-5150-b810-90388bb40a2b with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_8dfbe78efb034ebc549279a58eb33615.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9a9b43c99cec20f0c5e20677c5c40caf.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9ef1f62ed9010d18b1b82c40fc9ea02c.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_2c07801e7dcbb196f05b47af076e8f86.jpg not downloaded yet
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_76672acf0e0ad62afab7fa8ab880c387.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_97d9946a75a08aa43efecff5c6026894.jpg not downloaded yet
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_bd4376d2ca21e0352eeeef6606c0da2c.jpg not downloaded yet
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9b90>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_26d5178f8906865d17ad1404a60e3d77.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b00910>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_ade7576caf1a30ddb92e8cf712792645.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67a90>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_e065931f0ad35a897681865855a9be37.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_4988708fe721dc03b301eab719676b62.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a9d7150b316fe59be5e3e6adce487746.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_71d52394b1197cb6b09c8ae449e619a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_6f07dea7b940a118837de6dc5f887e46.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a2890>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_76672acf0e0ad62afab7fa8ab880c387.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8143821-a277-5411-beee-c39c78f67533
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8143821-a277-5411-beee-c39c78f67533, skipping ID generation
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8143821-a277-5411-beee-c39c78f67533 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8143821-a277-5411-beee-c39c78f67533 sending to next pipeline
2026-04-27 08:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8143821-a277-5411-beee-c39c78f67533, identifier: YG99324
2026-04-27 08:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8143821-a277-5411-beee-c39c78f67533 with identifier: YG99324
2026-04-27 08:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8143821-a277-5411-beee-c39c78f67533 with identifier: YG99324
2026-04-27 08:03:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8143821-a277-5411-beee-c39c78f67533 with identifier: YG99324 to the API
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_76672acf0e0ad62afab7fa8ab880c387.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'city': 'Helvesiek',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-04-28T15:56:14Z',
 'fuel_type': 'petrol',
 'id': 'c8143821-a277-5411-beee-c39c78f67533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.2161,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG99324',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'location_confidence': 'geocoded',
 'longitude': 9.4915,
 'make': 'Ford',
 'model': 'Tourneo',
 'odometer': 112772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_76672acf0e0ad62afab7fa8ab880c387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_26d5178f8906865d17ad1404a60e3d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_a288a21467ac2b9f223d7f752b54297b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_d73e16c456ca55f3dcfbee7281926ae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_e065931f0ad35a897681865855a9be37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_ade7576caf1a30ddb92e8cf712792645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_6dde99a74ac1bb9f86c02d547ee07b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_c2ef1281a1868d8ab69c1d34b509a179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_65db953ea354a677539ce5af82a1275b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c8143821-a277-5411-beee-c39c78f67533/c8143821-a277-5411-beee-c39c78f67533_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/57/85576db6d580557e7f23b19fa8618fca/pa/YG99324_242cbc15fe64adfd85eaf64544dd9e01.jpg',
             'Width': 800}],
 'postal_code': '27389',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2019-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-04-27 08:03:53 [auto1.de] INFO: Saving data for YG99324: {'created_time': 1777277033.858273, 'last_price_update_time': 1777277033.858283, 'has_photos': True, 'auction_closing_time': 1777391774.0}
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_70ee40fbea5aab644a9f7b35b884db5e.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9ef1f62ed9010d18b1b82c40fc9ea02c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cea310>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a9d7150b316fe59be5e3e6adce487746.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2f210>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_71d52394b1197cb6b09c8ae449e619a1.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_bd4376d2ca21e0352eeeef6606c0da2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_b22f22b3f91c700528d2344160668a85.jpg not downloaded yet
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5310>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9ef1f62ed9010d18b1b82c40fc9ea02c.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30043a10>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_bd4376d2ca21e0352eeeef6606c0da2c.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_4988708fe721dc03b301eab719676b62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_70ee40fbea5aab644a9f7b35b884db5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_6f07dea7b940a118837de6dc5f887e46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30195290>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_4988708fe721dc03b301eab719676b62.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014d190>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_70ee40fbea5aab644a9f7b35b884db5e.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_b22f22b3f91c700528d2344160668a85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba57d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_6f07dea7b940a118837de6dc5f887e46.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_97d9946a75a08aa43efecff5c6026894.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9a9b43c99cec20f0c5e20677c5c40caf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_8dfbe78efb034ebc549279a58eb33615.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a000c845bcadb0f8a0f439840dcde41f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30158950>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_b22f22b3f91c700528d2344160668a85.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_2c07801e7dcbb196f05b47af076e8f86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_c3003d54f41f29f84ff448274853d13e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042fd0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_97d9946a75a08aa43efecff5c6026894.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40590>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9a9b43c99cec20f0c5e20677c5c40caf.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_6df4c8c6412381fd1fddb247be6ec30b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3ed90>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_8dfbe78efb034ebc549279a58eb33615.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d050>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a000c845bcadb0f8a0f439840dcde41f.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7912941-4712-5304-9865-091d5879cbbe
2026-04-27 08:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7912941-4712-5304-9865-091d5879cbbe, skipping ID generation
2026-04-27 08:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7912941-4712-5304-9865-091d5879cbbe with scrape type 1
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7912941-4712-5304-9865-091d5879cbbe sending to next pipeline
2026-04-27 08:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7912941-4712-5304-9865-091d5879cbbe, identifier: UF78071
2026-04-27 08:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7912941-4712-5304-9865-091d5879cbbe with identifier: UF78071
2026-04-27 08:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7912941-4712-5304-9865-091d5879cbbe with identifier: UF78071
2026-04-27 08:03:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7912941-4712-5304-9865-091d5879cbbe with identifier: UF78071 to the API
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a000c845bcadb0f8a0f439840dcde41f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'city': 'Germersheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:18:03Z',
 'fuel_type': 'petrol',
 'id': 'a7912941-4712-5304-9865-091d5879cbbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF78071',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 195747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a000c845bcadb0f8a0f439840dcde41f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_fce98b6000cb58a8f0f0ea1fa0be17ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_a9d7150b316fe59be5e3e6adce487746.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_71d52394b1197cb6b09c8ae449e619a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_7f2a53eff46aaa4712a8d3651a5747fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_ac60d88ff1e91cfa6fde539ec0afa353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_c0d99982b5b1133be4499654e46fbf1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_764c87ec2cc8aab7bf7f280f1d04dd90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_521ce0c5cb86ddeca38a489906125182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a7912941-4712-5304-9865-091d5879cbbe/a7912941-4712-5304-9865-091d5879cbbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/90/aa909d0b69420e391baf5340888338d5/pa/UF78071_e4b2fd658f6c6da7ebdec968d5074d88.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2008-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Track & Field 4Motion',
 'transmission': 'manual',
 'trim': 'Track & Field 4Motion',
 'year': 2008}
2026-04-27 08:03:55 [auto1.de] INFO: Saving data for UF78071: {'created_time': 1777277035.238564, 'last_price_update_time': 1777277035.238574, 'has_photos': True, 'auction_closing_time': 1777389483.0}
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_53d63aac142d8bb71c84787c54fc79d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_e43784c58f2660a93adf7537ff1395ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026e590>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_2c07801e7dcbb196f05b47af076e8f86.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1777e40b-7358-5150-b810-90388bb40a2b
2026-04-27 08:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1777e40b-7358-5150-b810-90388bb40a2b, skipping ID generation
2026-04-27 08:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1777e40b-7358-5150-b810-90388bb40a2b with scrape type 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1777e40b-7358-5150-b810-90388bb40a2b sending to next pipeline
2026-04-27 08:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1777e40b-7358-5150-b810-90388bb40a2b, identifier: VS15824
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db4310>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_c3003d54f41f29f84ff448274853d13e.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30
2026-04-27 08:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d58cd1d-270c-556e-ad38-8cc097ae2a30, skipping ID generation
2026-04-27 08:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 sending to next pipeline
2026-04-27 08:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d58cd1d-270c-556e-ad38-8cc097ae2a30, identifier: NT88605
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffa950>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_6df4c8c6412381fd1fddb247be6ec30b.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1777e40b-7358-5150-b810-90388bb40a2b with identifier: VS15824
2026-04-27 08:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1777e40b-7358-5150-b810-90388bb40a2b with identifier: VS15824
2026-04-27 08:03:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1777e40b-7358-5150-b810-90388bb40a2b with identifier: VS15824 to the API
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_2c07801e7dcbb196f05b47af076e8f86.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'Dortmund',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:43:33Z',
 'fuel_type': 'petrol',
 'id': '1777e40b-7358-5150-b810-90388bb40a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS15824',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 76257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_8dfbe78efb034ebc549279a58eb33615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9a9b43c99cec20f0c5e20677c5c40caf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_9ef1f62ed9010d18b1b82c40fc9ea02c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_2c07801e7dcbb196f05b47af076e8f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_97d9946a75a08aa43efecff5c6026894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_bd4376d2ca21e0352eeeef6606c0da2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_4988708fe721dc03b301eab719676b62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_6f07dea7b940a118837de6dc5f887e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_70ee40fbea5aab644a9f7b35b884db5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1777e40b-7358-5150-b810-90388bb40a2b/1777e40b-7358-5150-b810-90388bb40a2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/be/3fbe1d575d48dfaae6adf1b4d54cc1d9/pa/VS15824_b22f22b3f91c700528d2344160668a85.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation Start&Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start&Stop',
 'year': 2018}
2026-04-27 08:03:55 [auto1.de] INFO: Saving data for VS15824: {'created_time': 1777277035.929393, 'last_price_update_time': 1777277035.929401, 'has_photos': True, 'auction_closing_time': 1777391013.0}
2026-04-27 08:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-04-27 08:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-04-27 08:03:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605 to the API
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_c3003d54f41f29f84ff448274853d13e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '2d58cd1d-270c-556e-ad38-8cc097ae2a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT88605',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_c3003d54f41f29f84ff448274853d13e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_e5ac1c7d4076a29e06a69ecf7891c2a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_9f5e70c4acddac4dfec88d1c7c8c4e26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_df8d4dfd4d3c988fdf0425d0415ba75e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_f8e91aadb6e3af21fa99784e1fc53a38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_92686a43c61e22838f44fdba48fe183b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_30e3bb47136545b9b5b5def375394cdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_64b6f0d516af938bb63c0b1c459fac3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_5c46fa6b54c2f6c305627ab638486bb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d58cd1d-270c-556e-ad38-8cc097ae2a30/2d58cd1d-270c-556e-ad38-8cc097ae2a30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a7d27a3e70a48caead83e6ced374fd/pa/NT88605_ee584722595376b3d5f3c3948fe71b10.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2017-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Sound',
 'transmission': 'automatic',
 'trim': 'Sound',
 'year': 2017}
2026-04-27 08:03:56 [auto1.de] INFO: Saving data for NT88605: {'created_time': 1777277036.295677, 'last_price_update_time': 1777277036.295686, 'has_photos': True, 'auction_closing_time': 1777391362.0}
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2db90>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_53d63aac142d8bb71c84787c54fc79d4.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65c50>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_e43784c58f2660a93adf7537ff1395ad.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3f39da4-519b-5dc4-99bb-1a4ee724c012
2026-04-27 08:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3f39da4-519b-5dc4-99bb-1a4ee724c012, skipping ID generation
2026-04-27 08:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f39da4-519b-5dc4-99bb-1a4ee724c012 with scrape type 1
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3f39da4-519b-5dc4-99bb-1a4ee724c012 sending to next pipeline
2026-04-27 08:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3f39da4-519b-5dc4-99bb-1a4ee724c012, identifier: ZH98222
2026-04-27 08:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3f39da4-519b-5dc4-99bb-1a4ee724c012 with identifier: ZH98222
2026-04-27 08:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3f39da4-519b-5dc4-99bb-1a4ee724c012 with identifier: ZH98222
2026-04-27 08:03:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3f39da4-519b-5dc4-99bb-1a4ee724c012 with identifier: ZH98222 to the API
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_e43784c58f2660a93adf7537ff1395ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:07:31Z',
 'fuel_type': 'petrol',
 'id': 'a3f39da4-519b-5dc4-99bb-1a4ee724c012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH98222',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 215945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_6df4c8c6412381fd1fddb247be6ec30b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_e43784c58f2660a93adf7537ff1395ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_53d63aac142d8bb71c84787c54fc79d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_3a2b6f0241b2492009e00e8b6521df34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3f39da4-519b-5dc4-99bb-1a4ee724c012/a3f39da4-519b-5dc4-99bb-1a4ee724c012_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/36/b7361939b4604886df1e4893a20cbc95/pa/ZH98222_d11751feab022d32cda586406f233ecf.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2013-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2013}
2026-04-27 08:03:56 [auto1.de] INFO: Saving data for ZH98222: {'created_time': 1777277036.804145, 'last_price_update_time': 1777277036.804156, 'has_photos': True, 'auction_closing_time': 1777388851.0}
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM11561> (referer: https://www.auto1.com/v1/car-details-view/YM11561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-04-27 08:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 1
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_5a3c2add61d0611b0022a05a067d2951.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_9d203e7602684bfb3b9cc4acda97f218.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_90acf198154b32525aef80bdd3f090cd.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_40c9f3d626fbe8442a8541e19a044180.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_807febae50d38b66bc0fec43386c2f3c.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_bff929308ea88dd7b7cd44260e44bf7f.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_dc87528ae30661779a21426e6321c7be.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_698a4c1922edd54b950315aab02aadf6.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_c4ba2491addb92230fd86ceb92387510.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_af81a1148a10815582a0570969b2b503.jpg not downloaded yet
2026-04-27 08:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH30741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_af81a1148a10815582a0570969b2b503.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35b90>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_af81a1148a10815582a0570969b2b503.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_c4ba2491addb92230fd86ceb92387510.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebbe90>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_c4ba2491addb92230fd86ceb92387510.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF83058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_698a4c1922edd54b950315aab02aadf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf12d0>
2026-04-27 08:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_698a4c1922edd54b950315aab02aadf6.jpg saved to cache
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR24268> (referer: https://www.auto1.com/v1/car-details-view/CR24268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with identifier: CR24268
2026-04-27 08:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with scrape type 1
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_da3cf590f85a6bf39e5703afba3f8dfd.jpg not downloaded yet
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_7e7ee6a3bf7aea99ea220bd0123caa18.jpg not downloaded yet
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_3b857d6fb05f7f332c6ab786b7e0ecca.jpg not downloaded yet
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_bb58aec446e8a167274d0da51ffee892.jpg not downloaded yet
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_b178f0b4dfaf9667ca2a02e9a5189451.jpg not downloaded yet
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_f03ae969e501aff4adc7187454537661.jpg not downloaded yet
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_dc87528ae30661779a21426e6321c7be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_f03ae969e501aff4adc7187454537661.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2cb90>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_dc87528ae30661779a21426e6321c7be.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_b178f0b4dfaf9667ca2a02e9a5189451.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051b50>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_f03ae969e501aff4adc7187454537661.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_bb58aec446e8a167274d0da51ffee892.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_3b857d6fb05f7f332c6ab786b7e0ecca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66e10>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_b178f0b4dfaf9667ca2a02e9a5189451.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_7e7ee6a3bf7aea99ea220bd0123caa18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053a10>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_bb58aec446e8a167274d0da51ffee892.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_da3cf590f85a6bf39e5703afba3f8dfd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016c350>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_3b857d6fb05f7f332c6ab786b7e0ecca.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018aed0>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_7e7ee6a3bf7aea99ea220bd0123caa18.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0be90>
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_da3cf590f85a6bf39e5703afba3f8dfd.jpg saved to cache
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3
2026-04-27 08:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3, skipping ID generation
2026-04-27 08:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with scrape type 1
2026-04-27 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 sending to next pipeline
2026-04-27 08:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3, identifier: CR24268
2026-04-27 08:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with identifier: CR24268
2026-04-27 08:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with identifier: CR24268
2026-04-27 08:04:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3 with identifier: CR24268 to the API
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_da3cf590f85a6bf39e5703afba3f8dfd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Oberding',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.0L',
 'engine_horse_power': 128,
 'expiration_date': '2026-04-28T15:54:54Z',
 'fuel_type': 'petrol',
 'id': '340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3167,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR24268',
 'listing': 'auction',
 'location': 'DE, Oberding',
 'location_confidence': 'geocoded',
 'longitude': 11.85,
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 210426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_da3cf590f85a6bf39e5703afba3f8dfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_7e7ee6a3bf7aea99ea220bd0123caa18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_3b857d6fb05f7f332c6ab786b7e0ecca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_bb58aec446e8a167274d0da51ffee892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_b178f0b4dfaf9667ca2a02e9a5189451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3/340d8fcb-63b7-5e8c-8f92-f89fbb5e5ce3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/9a/d09a468c795f7fb9fc28688ccb4a2446/pa/CR24268_f03ae969e501aff4adc7187454537661.jpg',
             'Width': 800}],
 'postal_code': '85445',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '1999-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 1999}
2026-04-27 08:04:08 [auto1.de] INFO: Saving data for CR24268: {'created_time': 1777277048.226757, 'last_price_update_time': 1777277048.226768, 'has_photos': True, 'auction_closing_time': 1777391694.0}
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_bff929308ea88dd7b7cd44260e44bf7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC54286> (referer: https://www.auto1.com/v1/car-details-view/PC54286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_40c9f3d626fbe8442a8541e19a044180.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b430d0>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_bff929308ea88dd7b7cd44260e44bf7f.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_9d203e7602684bfb3b9cc4acda97f218.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_90acf198154b32525aef80bdd3f090cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 10624 | hits on page: 40
2026-04-27 08:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-04-27 08:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 1
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_b59e99e14ee5c60a1b81f0fac10e3e4c.jpg not downloaded yet
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: JK90168
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_86a0d156ad0d3c882f6b7e442038c817.jpg not downloaded yet
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_807febae50d38b66bc0fec43386c2f3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: YF83058
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_99f441227db8d1f87f62d17ed0a41ba4.jpg not downloaded yet
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b42710>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_40c9f3d626fbe8442a8541e19a044180.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: PC54286
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_4247e6e9dfa73c7c275f99b5117be19b.jpg not downloaded yet
2026-04-27 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_5a3c2add61d0611b0022a05a067d2951.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: VM03652
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_d35c83940aeaa468bed6efbb6407094b.jpg not downloaded yet
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fce550>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_9d203e7602684bfb3b9cc4acda97f218.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8b210>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_90acf198154b32525aef80bdd3f090cd.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: YG99324
2026-04-27 08:04:08 [auto1.de] INFO: Scrape type for YG99324: 0
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: BU23816
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_07b209793c2e3ca10d19b9348af0e036.jpg not downloaded yet
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd9750>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_807febae50d38b66bc0fec43386c2f3c.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4fc10>
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_5a3c2add61d0611b0022a05a067d2951.jpg saved to cache
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f38dc16c-f002-590a-9f8a-847082f8cc7a
2026-04-27 08:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f38dc16c-f002-590a-9f8a-847082f8cc7a, skipping ID generation
2026-04-27 08:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 1
2026-04-27 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f38dc16c-f002-590a-9f8a-847082f8cc7a sending to next pipeline
2026-04-27 08:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38dc16c-f002-590a-9f8a-847082f8cc7a, identifier: YM11561
2026-04-27 08:04:08 [auto1.de] INFO: Found listing with ID: CA60323
2026-04-27 08:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-04-27 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-04-27 08:04:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-04-27 08:04:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561 to the API
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_5a3c2add61d0611b0022a05a067d2951.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:54:49Z',
 'fuel_type': 'diesel',
 'id': 'f38dc16c-f002-590a-9f8a-847082f8cc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM11561',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 97688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_5a3c2add61d0611b0022a05a067d2951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_9d203e7602684bfb3b9cc4acda97f218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_90acf198154b32525aef80bdd3f090cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_40c9f3d626fbe8442a8541e19a044180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_807febae50d38b66bc0fec43386c2f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_bff929308ea88dd7b7cd44260e44bf7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_dc87528ae30661779a21426e6321c7be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_698a4c1922edd54b950315aab02aadf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_c4ba2491addb92230fd86ceb92387510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f38dc16c-f002-590a-9f8a-847082f8cc7a/f38dc16c-f002-590a-9f8a-847082f8cc7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/c3/ddc356fa983c67a44b5344f5d2545850/pa/YM11561_af81a1148a10815582a0570969b2b503.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2019-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2019}
2026-04-27 08:04:09 [auto1.de] INFO: Saving data for YM11561: {'created_time': 1777277049.404318, 'last_price_update_time': 1777277049.404328, 'has_photos': True, 'auction_closing_time': 1777391689.0}
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_86a0d156ad0d3c882f6b7e442038c817.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_4247e6e9dfa73c7c275f99b5117be19b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: BN04464
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: ET24153
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for ET24153: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: AV91835
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for AV91835: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: MB11213
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for MB11213: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: SF38506
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for SF38506: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: CE38589
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for CE38589: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: UE66313
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for UE66313: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: PB07768
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for PB07768: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: LA33826
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for LA33826: 0
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: KD28185
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: XU93534
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for XU93534: 1
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_07b209793c2e3ca10d19b9348af0e036.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: ED13433
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for ED13433: 1
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a58ed0>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_86a0d156ad0d3c882f6b7e442038c817.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd6d90>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_4247e6e9dfa73c7c275f99b5117be19b.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: LG62730
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for LG62730: 1
2026-04-27 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_d35c83940aeaa468bed6efbb6407094b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: ZC11343
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for ZC11343: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: SL85430
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for SL85430: 1
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028bb50>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_07b209793c2e3ca10d19b9348af0e036.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: PE12481
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for PE12481: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: SY15259
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for SY15259: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: EM10383
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for EM10383: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: SS01241
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for SS01241: 1
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15a50>
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_d35c83940aeaa468bed6efbb6407094b.jpg saved to cache
2026-04-27 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: ZE36706
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for ZE36706: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: LY70267
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for LY70267: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: PU83477
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for PU83477: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: XY85636
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for XY85636: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: VM97001
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for VM97001: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: WK54006
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for WK54006: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: BE46966
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for BE46966: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: LD63966
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for LD63966: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: LX06150
2026-04-27 08:04:09 [auto1.de] INFO: Scrape type for LX06150: 1
2026-04-27 08:04:09 [auto1.de] INFO: Found listing with ID: TP67168
2026-04-27 08:04:10 [auto1.de] INFO: Scrape type for TP67168: 1
2026-04-27 08:04:10 [auto1.de] INFO: Found listing with ID: EM35795
2026-04-27 08:04:10 [auto1.de] INFO: Scrape type for EM35795: 1
2026-04-27 08:04:10 [auto1.de] INFO: Found listing with ID: AK26500
2026-04-27 08:04:10 [auto1.de] INFO: Scrape type for AK26500: 1
2026-04-27 08:04:10 [auto1.de] INFO: Found listing with ID: XL56937
2026-04-27 08:04:10 [auto1.de] INFO: Scrape type for XL56937: 1
2026-04-27 08:04:10 [auto1.de] INFO: Found listing with ID: CP48685
2026-04-27 08:04:10 [auto1.de] INFO: Scrape type for CP48685: 1
2026-04-27 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU23816> (referer: https://www.auto1.com/v1/car-details-view/BU23816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de59baac-25e3-52fc-9432-8edb20ac1d6c with identifier: BU23816
2026-04-27 08:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de59baac-25e3-52fc-9432-8edb20ac1d6c with scrape type 1
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_1178d662ce9d5ab4757c3d9f181385df.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_78dbe6841c559a36f4be0aebac515a56.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_3d89ac9c4461f6c81ce3958e736a0254.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_e291ceb618dd65f35dff4b8f9f5c228a.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_449c0ea9254931f10ec1efb2b0842e86.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_ed0a81ca44eca47b518e241f8974abd7.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_cdfeeca796a6e9c54d37e762f560b086.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_a11253390924591c375d6ca0b47affea.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_b5ca1160ed0dcc4203b67a10a7ec48ac.jpg not downloaded yet
2026-04-27 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_02acb963be7020e95241972fbc602283.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK69314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_02acb963be7020e95241972fbc602283.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM03652> (referer: https://www.auto1.com/v1/car-details-view/VM03652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028af50>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_02acb963be7020e95241972fbc602283.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with identifier: VM03652
2026-04-27 08:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with scrape type 1
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_34ee636f38be6b8aafacec49085cb46a.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_b5ca1160ed0dcc4203b67a10a7ec48ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_fc3264917c5b5ccc1c4d320e259c0c50.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_73ef8d381839d750eae7e42668adc2dd.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4e4a241b881d1e90b2ace5ea16ce5db4.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_786a3ce3f2d9ab13db0579fcdac96b26.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_5ce128017909002837129601bda30515.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4501f268d440381402c32f69bfd51e52.jpg not downloaded yet
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_34ee636f38be6b8aafacec49085cb46a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_9e082f4d21df73571846412669e63c6e.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_2254779c46e96441e6e0ec36068b66fb.jpg not downloaded yet
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_57b48e8c9b2c8544b02a3536a535cb70.jpg not downloaded yet
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006cfd0>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_b5ca1160ed0dcc4203b67a10a7ec48ac.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35510>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_34ee636f38be6b8aafacec49085cb46a.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4501f268d440381402c32f69bfd51e52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_57b48e8c9b2c8544b02a3536a535cb70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015ba90>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4501f268d440381402c32f69bfd51e52.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8090>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_57b48e8c9b2c8544b02a3536a535cb70.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_2254779c46e96441e6e0ec36068b66fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM06775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_5ce128017909002837129601bda30515.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30158510>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_2254779c46e96441e6e0ec36068b66fb.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY14465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_786a3ce3f2d9ab13db0579fcdac96b26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016cb90>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_5ce128017909002837129601bda30515.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4e4a241b881d1e90b2ace5ea16ce5db4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_73ef8d381839d750eae7e42668adc2dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2cf90>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_786a3ce3f2d9ab13db0579fcdac96b26.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_fc3264917c5b5ccc1c4d320e259c0c50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_9e082f4d21df73571846412669e63c6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce9010>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4e4a241b881d1e90b2ace5ea16ce5db4.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_a11253390924591c375d6ca0b47affea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30158e10>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_73ef8d381839d750eae7e42668adc2dd.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e68a90>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_fc3264917c5b5ccc1c4d320e259c0c50.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e901d0>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_9e082f4d21df73571846412669e63c6e.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6
2026-04-27 08:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6, skipping ID generation
2026-04-27 08:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with scrape type 1
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 sending to next pipeline
2026-04-27 08:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6, identifier: VM03652
2026-04-27 08:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with identifier: VM03652
2026-04-27 08:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with identifier: VM03652
2026-04-27 08:04:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6 with identifier: VM03652 to the API
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_9e082f4d21df73571846412669e63c6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'city': 'Kandel',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:49:15Z',
 'fuel_type': 'petrol',
 'id': 'eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM03652',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 70909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65010,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_34ee636f38be6b8aafacec49085cb46a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54174,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_fc3264917c5b5ccc1c4d320e259c0c50.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_73ef8d381839d750eae7e42668adc2dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55350,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4e4a241b881d1e90b2ace5ea16ce5db4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_786a3ce3f2d9ab13db0579fcdac96b26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_5ce128017909002837129601bda30515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_4501f268d440381402c32f69bfd51e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_9e082f4d21df73571846412669e63c6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56905,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_2254779c46e96441e6e0ec36068b66fb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6/eb99b3f0-ec1b-5b81-bc3c-7f0475f7b6a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b0/46b0979bbc8eb6d0356a0e3a038cd59a/pa/VM03652_57b48e8c9b2c8544b02a3536a535cb70.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2014-09-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2014}
2026-04-27 08:04:18 [auto1.de] INFO: Saving data for VM03652: {'created_time': 1777277058.357592, 'last_price_update_time': 1777277058.357602, 'has_photos': True, 'auction_closing_time': 1777391355.0}
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_cdfeeca796a6e9c54d37e762f560b086.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ65862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce8d90>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_a11253390924591c375d6ca0b47affea.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD28185> (referer: https://www.auto1.com/v1/car-details-view/KD28185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b74bd0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_cdfeeca796a6e9c54d37e762f560b086.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a537f62-2568-542d-bd7e-94294fa49ffc with identifier: KD28185
2026-04-27 08:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a537f62-2568-542d-bd7e-94294fa49ffc with scrape type 1
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_e74776f5138b0135be1f2f4ea0704459.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_6e3d5e2f199e678b3ec55e905f3d13bf.jpg not downloaded yet
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_ed0a81ca44eca47b518e241f8974abd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_4282e37401829fcaadfb82ce173a3292.jpg not downloaded yet
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_e291ceb618dd65f35dff4b8f9f5c228a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_efeca8a1b42b41c4ed5f9c3e17ff84ce.jpg not downloaded yet
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_449c0ea9254931f10ec1efb2b0842e86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_12fa6d9264393c2c7d5bbd10735d33cd.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_d52a73f9ead7ff6533ddc7dcc4aa5e8e.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_96fa7b501921c7067803e94a058ccec8.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_b8d59475d79d476c9c18031909d52368.jpg not downloaded yet
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_e74776f5138b0135be1f2f4ea0704459.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_766ca17d619c80216e69c954c9f80f5d.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_65ed28b958b993ca4bd9c09bac56a5dd.jpg not downloaded yet
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eab990>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_ed0a81ca44eca47b518e241f8974abd7.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e550>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_e291ceb618dd65f35dff4b8f9f5c228a.jpg saved to cache
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_6e3d5e2f199e678b3ec55e905f3d13bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_efeca8a1b42b41c4ed5f9c3e17ff84ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f34fd0>
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_449c0ea9254931f10ec1efb2b0842e86.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_96fa7b501921c7067803e94a058ccec8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1590>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_e74776f5138b0135be1f2f4ea0704459.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_65ed28b958b993ca4bd9c09bac56a5dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2e290>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_6e3d5e2f199e678b3ec55e905f3d13bf.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_d52a73f9ead7ff6533ddc7dcc4aa5e8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ac790>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_efeca8a1b42b41c4ed5f9c3e17ff84ce.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35f90>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_96fa7b501921c7067803e94a058ccec8.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_12fa6d9264393c2c7d5bbd10735d33cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb8e90>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_65ed28b958b993ca4bd9c09bac56a5dd.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_b8d59475d79d476c9c18031909d52368.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_766ca17d619c80216e69c954c9f80f5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_4282e37401829fcaadfb82ce173a3292.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH30741> (referer: https://www.auto1.com/v1/car-details-view/XH30741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67ed0>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_d52a73f9ead7ff6533ddc7dcc4aa5e8e.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f66d0>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_12fa6d9264393c2c7d5bbd10735d33cd.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93790>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_b8d59475d79d476c9c18031909d52368.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_78dbe6841c559a36f4be0aebac515a56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1bd0>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_766ca17d619c80216e69c954c9f80f5d.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196410>
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_4282e37401829fcaadfb82ce173a3292.jpg saved to cache
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a537f62-2568-542d-bd7e-94294fa49ffc
2026-04-27 08:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a537f62-2568-542d-bd7e-94294fa49ffc, skipping ID generation
2026-04-27 08:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a537f62-2568-542d-bd7e-94294fa49ffc with scrape type 1
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a537f62-2568-542d-bd7e-94294fa49ffc sending to next pipeline
2026-04-27 08:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a537f62-2568-542d-bd7e-94294fa49ffc, identifier: KD28185
2026-04-27 08:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7948a2-490e-564a-ad4e-c279728c76f1 with identifier: XH30741
2026-04-27 08:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7948a2-490e-564a-ad4e-c279728c76f1 with scrape type 1
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_294019be8d1b62d6b639c3802c59c9f8.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a537f62-2568-542d-bd7e-94294fa49ffc with identifier: KD28185
2026-04-27 08:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a537f62-2568-542d-bd7e-94294fa49ffc with identifier: KD28185
2026-04-27 08:04:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a537f62-2568-542d-bd7e-94294fa49ffc with identifier: KD28185 to the API
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_4282e37401829fcaadfb82ce173a3292.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:48:26Z',
 'fuel_type': 'diesel',
 'id': '9a537f62-2568-542d-bd7e-94294fa49ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD28185',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 110487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_e74776f5138b0135be1f2f4ea0704459.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_6e3d5e2f199e678b3ec55e905f3d13bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_4282e37401829fcaadfb82ce173a3292.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_efeca8a1b42b41c4ed5f9c3e17ff84ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_12fa6d9264393c2c7d5bbd10735d33cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_d52a73f9ead7ff6533ddc7dcc4aa5e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_96fa7b501921c7067803e94a058ccec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_b8d59475d79d476c9c18031909d52368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_766ca17d619c80216e69c954c9f80f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a537f62-2568-542d-bd7e-94294fa49ffc/9a537f62-2568-542d-bd7e-94294fa49ffc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/53/de53e5b3350e7852b2a39b97445dbfe1/pa/KD28185_65ed28b958b993ca4bd9c09bac56a5dd.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-07-03',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2017}
2026-04-27 08:04:20 [auto1.de] INFO: Saving data for KD28185: {'created_time': 1777277060.423686, 'last_price_update_time': 1777277060.423699, 'has_photos': True, 'auction_closing_time': 1777391306.0}
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6027ac8750c4540e6c0f08ac734d5461.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_3d89ac9c4461f6c81ce3958e736a0254.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_1178d662ce9d5ab4757c3d9f181385df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6c87e1f36256e6c8010d77a0d1c46442.jpg not downloaded yet
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f37390>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_78dbe6841c559a36f4be0aebac515a56.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_15b71a2d3cb2b7c09de9fd803fdfc685.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_7219d4bc5928b430f548e6cf67d6841a.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_b776d3931080afbfe41f76692f1fd47d.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_358f277f63457a01ec0f51cb96824306.jpg not downloaded yet
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e90e90>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_3d89ac9c4461f6c81ce3958e736a0254.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b02a90>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_1178d662ce9d5ab4757c3d9f181385df.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de59baac-25e3-52fc-9432-8edb20ac1d6c
2026-04-27 08:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de59baac-25e3-52fc-9432-8edb20ac1d6c, skipping ID generation
2026-04-27 08:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de59baac-25e3-52fc-9432-8edb20ac1d6c with scrape type 1
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de59baac-25e3-52fc-9432-8edb20ac1d6c sending to next pipeline
2026-04-27 08:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de59baac-25e3-52fc-9432-8edb20ac1d6c, identifier: BU23816
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_294019be8d1b62d6b639c3802c59c9f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_d5751e0cbbfef26696561efcaadaa762.jpg not downloaded yet
2026-04-27 08:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de59baac-25e3-52fc-9432-8edb20ac1d6c with identifier: BU23816
2026-04-27 08:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de59baac-25e3-52fc-9432-8edb20ac1d6c with identifier: BU23816
2026-04-27 08:04:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de59baac-25e3-52fc-9432-8edb20ac1d6c with identifier: BU23816 to the API
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_1178d662ce9d5ab4757c3d9f181385df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:34:05Z',
 'fuel_type': 'petrol',
 'id': 'de59baac-25e3-52fc-9432-8edb20ac1d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU23816',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 105127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_1178d662ce9d5ab4757c3d9f181385df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_78dbe6841c559a36f4be0aebac515a56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_3d89ac9c4461f6c81ce3958e736a0254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_e291ceb618dd65f35dff4b8f9f5c228a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_449c0ea9254931f10ec1efb2b0842e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_ed0a81ca44eca47b518e241f8974abd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_cdfeeca796a6e9c54d37e762f560b086.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_a11253390924591c375d6ca0b47affea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_b5ca1160ed0dcc4203b67a10a7ec48ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de59baac-25e3-52fc-9432-8edb20ac1d6c/de59baac-25e3-52fc-9432-8edb20ac1d6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/50/285092def775b36bb3483e64a5ebde85/pa/BU23816_02acb963be7020e95241972fbc602283.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-04-27 08:04:21 [auto1.de] INFO: Saving data for BU23816: {'created_time': 1777277061.176206, 'last_price_update_time': 1777277061.176216, 'has_photos': True, 'auction_closing_time': 1777390445.0}
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6027ac8750c4540e6c0f08ac734d5461.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_ed81b4f83419c325a53a0647dd34ca99.jpg not downloaded yet
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_74744799f8b0f324dcc47fd83c730f01.jpg not downloaded yet
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f06090>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_294019be8d1b62d6b639c3802c59c9f8.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f6010>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6027ac8750c4540e6c0f08ac734d5461.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_b776d3931080afbfe41f76692f1fd47d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_358f277f63457a01ec0f51cb96824306.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34ad0>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_b776d3931080afbfe41f76692f1fd47d.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3290>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_358f277f63457a01ec0f51cb96824306.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_ed81b4f83419c325a53a0647dd34ca99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_74744799f8b0f324dcc47fd83c730f01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db5050>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_ed81b4f83419c325a53a0647dd34ca99.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f7990>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_74744799f8b0f324dcc47fd83c730f01.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_7219d4bc5928b430f548e6cf67d6841a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_d5751e0cbbfef26696561efcaadaa762.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65110>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_7219d4bc5928b430f548e6cf67d6841a.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_15b71a2d3cb2b7c09de9fd803fdfc685.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f6550>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_d5751e0cbbfef26696561efcaadaa762.jpg saved to cache
2026-04-27 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK79364> (referer: https://www.auto1.com/v1/car-details-view/KK79364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d609d0>
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_15b71a2d3cb2b7c09de9fd803fdfc685.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6c87e1f36256e6c8010d77a0d1c46442.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b389141-7998-5706-9841-35022d4527be with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_c7c6b5fa51e9f3294a51dbce685260e6.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_ef368e3c949c1c206249c442af9132da.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_47d9faf1ecd312bae821962cd4a1f329.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_09458144600e2793e6f2065f75a975e3.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_32aab8224f6b52b86ca0107dc185eff9.jpg not downloaded yet
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f660d0>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6c87e1f36256e6c8010d77a0d1c46442.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de7948a2-490e-564a-ad4e-c279728c76f1
2026-04-27 08:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de7948a2-490e-564a-ad4e-c279728c76f1, skipping ID generation
2026-04-27 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7948a2-490e-564a-ad4e-c279728c76f1 with scrape type 1
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de7948a2-490e-564a-ad4e-c279728c76f1 sending to next pipeline
2026-04-27 08:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de7948a2-490e-564a-ad4e-c279728c76f1, identifier: XH30741
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_6ac60dd026ccf231f049880f6f42a939.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de7948a2-490e-564a-ad4e-c279728c76f1 with identifier: XH30741
2026-04-27 08:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de7948a2-490e-564a-ad4e-c279728c76f1 with identifier: XH30741
2026-04-27 08:04:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de7948a2-490e-564a-ad4e-c279728c76f1 with identifier: XH30741 to the API
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6c87e1f36256e6c8010d77a0d1c46442.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:36:23Z',
 'fuel_type': 'petrol',
 'id': 'de7948a2-490e-564a-ad4e-c279728c76f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH30741',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 131558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_294019be8d1b62d6b639c3802c59c9f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6027ac8750c4540e6c0f08ac734d5461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_6c87e1f36256e6c8010d77a0d1c46442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_15b71a2d3cb2b7c09de9fd803fdfc685.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_7219d4bc5928b430f548e6cf67d6841a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_b776d3931080afbfe41f76692f1fd47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_358f277f63457a01ec0f51cb96824306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_d5751e0cbbfef26696561efcaadaa762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_ed81b4f83419c325a53a0647dd34ca99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_de7948a2-490e-564a-ad4e-c279728c76f1/de7948a2-490e-564a-ad4e-c279728c76f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/6a/d06a55bebf2e44412c372623e9e8be11/pa/XH30741_74744799f8b0f324dcc47fd83c730f01.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2013-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-04-27 08:04:22 [auto1.de] INFO: Saving data for XH30741: {'created_time': 1777277062.763313, 'last_price_update_time': 1777277062.763323, 'has_photos': True, 'auction_closing_time': 1777390583.0}
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_adaecd6c69a92ba34a77d54ef9f60b61.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_7e870f1796850fc4bb8acbebe8bb165e.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_67a51581c3032cf51a79676157b63eb0.jpg not downloaded yet
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_49170e57b5ef1bfcd98dcd9b0d9b4089.jpg not downloaded yet
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP48685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_49170e57b5ef1bfcd98dcd9b0d9b4089.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1cd10>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_49170e57b5ef1bfcd98dcd9b0d9b4089.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK90168/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_67a51581c3032cf51a79676157b63eb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_7e870f1796850fc4bb8acbebe8bb165e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4d7d0>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_67a51581c3032cf51a79676157b63eb0.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF83058> (referer: https://www.auto1.com/v1/car-details-view/YF83058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016e590>
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_7e870f1796850fc4bb8acbebe8bb165e.jpg saved to cache
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with identifier: YF83058
2026-04-27 08:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with scrape type 1
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a646984fd629c2f5be27b3408f892190.jpg not downloaded yet
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9c1723ec4f7219bebc852ff8b0735c3b.jpg not downloaded yet
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_3968c7995c27497147398204c1769332.jpg not downloaded yet
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a66a84a36aa1c97330a44a00ed148d06.jpg not downloaded yet
2026-04-27 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_adaecd6c69a92ba34a77d54ef9f60b61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_b21e2ffb626d481fb4d1b3b06064d0ac.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_19273de9e3a826739918dba2be435a6b.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9576f7923070f96337b85f85200fa016.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_c154b6b78cf0cfb1c270159d612d6d19.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_4229ad381bb4fd976d4c8ca566d62c56.jpg not downloaded yet
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_71117eac02709295716619fa494a9c17.jpg not downloaded yet
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a66a84a36aa1c97330a44a00ed148d06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35350>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_adaecd6c69a92ba34a77d54ef9f60b61.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_71117eac02709295716619fa494a9c17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75350>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a66a84a36aa1c97330a44a00ed148d06.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67650>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_71117eac02709295716619fa494a9c17.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_4229ad381bb4fd976d4c8ca566d62c56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_c154b6b78cf0cfb1c270159d612d6d19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9df10>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_4229ad381bb4fd976d4c8ca566d62c56.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9576f7923070f96337b85f85200fa016.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04690>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_c154b6b78cf0cfb1c270159d612d6d19.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67d50>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9576f7923070f96337b85f85200fa016.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_19273de9e3a826739918dba2be435a6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_b21e2ffb626d481fb4d1b3b06064d0ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1e50>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_19273de9e3a826739918dba2be435a6b.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_3968c7995c27497147398204c1769332.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4ce90>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_b21e2ffb626d481fb4d1b3b06064d0ac.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c9d0>
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_3968c7995c27497147398204c1769332.jpg saved to cache
2026-04-27 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY14465> (referer: https://www.auto1.com/v1/car-details-view/BY14465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9c1723ec4f7219bebc852ff8b0735c3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a646984fd629c2f5be27b3408f892190.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10504cb0-5a50-5ff7-aa37-e107efe853ef with identifier: BY14465
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10504cb0-5a50-5ff7-aa37-e107efe853ef with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_3109201c327dceb153c068ecba8301da.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_9632fcba939f15ff530861f47dcafbea.jpg not downloaded yet
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_32aab8224f6b52b86ca0107dc185eff9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_4c25f19deb2128af5e2074eaf358d372.jpg not downloaded yet
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6e90>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9c1723ec4f7219bebc852ff8b0735c3b.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051150>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a646984fd629c2f5be27b3408f892190.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1ee370d-7f56-556e-af9e-bf1d025ffcb3, skipping ID generation
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1ee370d-7f56-556e-af9e-bf1d025ffcb3 sending to next pipeline
2026-04-27 08:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1ee370d-7f56-556e-af9e-bf1d025ffcb3, identifier: YF83058
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_a656d35efd5f0f1b522f7132074b17c5.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with identifier: YF83058
2026-04-27 08:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with identifier: YF83058
2026-04-27 08:04:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1ee370d-7f56-556e-af9e-bf1d025ffcb3 with identifier: YF83058 to the API
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a646984fd629c2f5be27b3408f892190.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Atting',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:34:07Z',
 'fuel_type': 'diesel',
 'id': 'f1ee370d-7f56-556e-af9e-bf1d025ffcb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF83058',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 218955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a646984fd629c2f5be27b3408f892190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9c1723ec4f7219bebc852ff8b0735c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_3968c7995c27497147398204c1769332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_a66a84a36aa1c97330a44a00ed148d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_b21e2ffb626d481fb4d1b3b06064d0ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_19273de9e3a826739918dba2be435a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_9576f7923070f96337b85f85200fa016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_c154b6b78cf0cfb1c270159d612d6d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_4229ad381bb4fd976d4c8ca566d62c56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f1ee370d-7f56-556e-af9e-bf1d025ffcb3/f1ee370d-7f56-556e-af9e-bf1d025ffcb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2b/cc2b89f2b9f56e9bb784498f6a4bc8cb/pa/YF83058_71117eac02709295716619fa494a9c17.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion Tech',
 'year': 2014}
2026-04-27 08:04:26 [auto1.de] INFO: Saving data for YF83058: {'created_time': 1777277066.792156, 'last_price_update_time': 1777277066.792167, 'has_photos': True, 'auction_closing_time': 1777390447.0}
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_6ac60dd026ccf231f049880f6f42a939.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_2a23e0694e853607738c5836e25cb9be.jpg not downloaded yet
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053450>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_32aab8224f6b52b86ca0107dc185eff9.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_1747822004e95670dfccb69cbb7cc21c.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_010a307fc8992ed2d46a0875deedfbeb.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_95e0be016d5f3b8a2e169afbcf838653.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_be39c38f5d0d41ac80c375414f002a55.jpg not downloaded yet
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2c90>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_6ac60dd026ccf231f049880f6f42a939.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_5bc582d00811a467cab05f443e058102.jpg not downloaded yet
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_9632fcba939f15ff530861f47dcafbea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_a656d35efd5f0f1b522f7132074b17c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d850>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_9632fcba939f15ff530861f47dcafbea.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d810>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_a656d35efd5f0f1b522f7132074b17c5.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_5bc582d00811a467cab05f443e058102.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6b050>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_5bc582d00811a467cab05f443e058102.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_be39c38f5d0d41ac80c375414f002a55.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_95e0be016d5f3b8a2e169afbcf838653.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d78750>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_be39c38f5d0d41ac80c375414f002a55.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_010a307fc8992ed2d46a0875deedfbeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b766d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_95e0be016d5f3b8a2e169afbcf838653.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006fd10>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_010a307fc8992ed2d46a0875deedfbeb.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_1747822004e95670dfccb69cbb7cc21c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_2a23e0694e853607738c5836e25cb9be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_3109201c327dceb153c068ecba8301da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef8750>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_1747822004e95670dfccb69cbb7cc21c.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da16d0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_2a23e0694e853607738c5836e25cb9be.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d810>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_3109201c327dceb153c068ecba8301da.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_4c25f19deb2128af5e2074eaf358d372.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_09458144600e2793e6f2065f75a975e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_ef368e3c949c1c206249c442af9132da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_c7c6b5fa51e9f3294a51dbce685260e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cef810>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_4c25f19deb2128af5e2074eaf358d372.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10504cb0-5a50-5ff7-aa37-e107efe853ef
2026-04-27 08:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10504cb0-5a50-5ff7-aa37-e107efe853ef, skipping ID generation
2026-04-27 08:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10504cb0-5a50-5ff7-aa37-e107efe853ef with scrape type 1
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10504cb0-5a50-5ff7-aa37-e107efe853ef sending to next pipeline
2026-04-27 08:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10504cb0-5a50-5ff7-aa37-e107efe853ef, identifier: BY14465
2026-04-27 08:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10504cb0-5a50-5ff7-aa37-e107efe853ef with identifier: BY14465
2026-04-27 08:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10504cb0-5a50-5ff7-aa37-e107efe853ef with identifier: BY14465
2026-04-27 08:04:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10504cb0-5a50-5ff7-aa37-e107efe853ef with identifier: BY14465 to the API
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_4c25f19deb2128af5e2074eaf358d372.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Fockbek',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:13:45Z',
 'fuel_type': 'petrol',
 'id': '10504cb0-5a50-5ff7-aa37-e107efe853ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY14465',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'BMW',
 'model': '1er',
 'odometer': 129402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_3109201c327dceb153c068ecba8301da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_9632fcba939f15ff530861f47dcafbea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_4c25f19deb2128af5e2074eaf358d372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_a656d35efd5f0f1b522f7132074b17c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_2a23e0694e853607738c5836e25cb9be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_1747822004e95670dfccb69cbb7cc21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_010a307fc8992ed2d46a0875deedfbeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_95e0be016d5f3b8a2e169afbcf838653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_be39c38f5d0d41ac80c375414f002a55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10504cb0-5a50-5ff7-aa37-e107efe853ef/10504cb0-5a50-5ff7-aa37-e107efe853ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/43/b843dd91353cd9b45a5b92f7c8cc16f3/pa/BY14465_5bc582d00811a467cab05f443e058102.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2014-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-04-27 08:04:28 [auto1.de] INFO: Saving data for BY14465: {'created_time': 1777277068.7185, 'last_price_update_time': 1777277068.718512, 'has_photos': True, 'auction_closing_time': 1777389225.0}
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_47d9faf1ecd312bae821962cd4a1f329.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee36d0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_09458144600e2793e6f2065f75a975e3.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cecd50>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_ef368e3c949c1c206249c442af9132da.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e310>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_c7c6b5fa51e9f3294a51dbce685260e6.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce9bd0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_47d9faf1ecd312bae821962cd4a1f329.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b389141-7998-5706-9841-35022d4527be
2026-04-27 08:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b389141-7998-5706-9841-35022d4527be, skipping ID generation
2026-04-27 08:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b389141-7998-5706-9841-35022d4527be with scrape type 1
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b389141-7998-5706-9841-35022d4527be sending to next pipeline
2026-04-27 08:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b389141-7998-5706-9841-35022d4527be, identifier: KK79364
2026-04-27 08:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-04-27 08:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-04-27 08:04:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364 to the API
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_47d9faf1ecd312bae821962cd4a1f329.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'city': 'Zülpich',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-04-28T15:28:40Z',
 'fuel_type': 'petrol',
 'id': '3b389141-7998-5706-9841-35022d4527be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK79364',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51228,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_c7c6b5fa51e9f3294a51dbce685260e6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50935,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_ef368e3c949c1c206249c442af9132da.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51876,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_47d9faf1ecd312bae821962cd4a1f329.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39439,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_09458144600e2793e6f2065f75a975e3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49082,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_32aab8224f6b52b86ca0107dc185eff9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50107,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_6ac60dd026ccf231f049880f6f42a939.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36290,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_adaecd6c69a92ba34a77d54ef9f60b61.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44887,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_7e870f1796850fc4bb8acbebe8bb165e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47696,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_67a51581c3032cf51a79676157b63eb0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b389141-7998-5706-9841-35022d4527be/3b389141-7998-5706-9841-35022d4527be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66286,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c0/bcc0e3fe3c4ad6fd03d2382cb9816761/pa/KK79364_49170e57b5ef1bfcd98dcd9b0d9b4089.jpg',
             'Width': 640}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2014}
2026-04-27 08:04:29 [auto1.de] INFO: Saving data for KK79364: {'created_time': 1777277069.342539, 'last_price_update_time': 1777277069.342548, 'has_photos': True, 'auction_closing_time': 1777390120.0}
2026-04-27 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM06775> (referer: https://www.auto1.com/v1/car-details-view/TM06775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with identifier: TM06775
2026-04-27 08:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with scrape type 1
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_88c0e695b709a31d5f8c708a602264eb.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_615216fd239b51b5a077a252c178a06b.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_08ff077751eb45c0e01c66a4c17032ca.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_01d62322d4d628938936d08ea06b7327.jpg not downloaded yet
2026-04-27 08:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_a24f74c2fe79508805311b741137ce59.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_90af7d69e9fd76581c4cb5cc8d332404.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7ee0b858127281c1ab398c14ad395bb0.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7d459ad8a3696c5307579dd940c6ca57.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_318ae96505616a42157728440f1a963d.jpg not downloaded yet
2026-04-27 08:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_1f60810412749d9ca14375a80f113f39.jpg not downloaded yet
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ65862> (referer: https://www.auto1.com/v1/car-details-view/FZ65862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-04-27 08:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with scrape type 1
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_249a076b4d47a853cf33e17f7a4f022f.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_4d0c38b28ce515c48be926bee09ede45.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_eae1bafc30914b222b08a94b632e3460.jpg not downloaded yet
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_1f60810412749d9ca14375a80f113f39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_cf79c4bc7c89acc28049aef21e3494b0.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_b14c391eec8071fabfda996258db4368.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_1464ebaae5f5e414b1d0ce6e7819cb77.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_795257393631090ac737c6e5f822b158.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_813df8fb58bf076bdff1cae006c3414b.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_22ae2f62f44cb448457e52768bc8fccd.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_c7973a76e3b4cc32de7848c27c00e2ec.jpg not downloaded yet
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30052a90>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_1f60810412749d9ca14375a80f113f39.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_eae1bafc30914b222b08a94b632e3460.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016f0d0>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_eae1bafc30914b222b08a94b632e3460.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_c7973a76e3b4cc32de7848c27c00e2ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c34d0>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_c7973a76e3b4cc32de7848c27c00e2ec.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_22ae2f62f44cb448457e52768bc8fccd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK69314> (referer: https://www.auto1.com/v1/car-details-view/NK69314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a49fd0>
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_22ae2f62f44cb448457e52768bc8fccd.jpg saved to cache
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb83144a-4228-5871-9d7e-f58becb68b93 with identifier: NK69314
2026-04-27 08:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb83144a-4228-5871-9d7e-f58becb68b93 with scrape type 1
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_4b614788e8d87b594275f9a20f0a695f.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_46303271176237fd3a764310a1d7cef3.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_813df8fb58bf076bdff1cae006c3414b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_b6f394fbdbebcdfa976ab82d0ca44a97.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_795257393631090ac737c6e5f822b158.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_5deee78b8ccc3d4fe9194c8201bc9ed3.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_6b3c9ea26cfc29563f38f71376062956.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_05f0a84102572486eff161a6a4be09db.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK26500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_79602c39b1385c67a70d4a3cfc6c5eeb.jpg not downloaded yet
2026-04-27 08:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_46303271176237fd3a764310a1d7cef3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_0d0530698974499b60aeed6d3b88424f.jpg not downloaded yet
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7a450>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_813df8fb58bf076bdff1cae006c3414b.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_c2b82343ea552425e6c9b1572420cee2.jpg not downloaded yet
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30194910>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_795257393631090ac737c6e5f822b158.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_54a95b12a5b37511aa07845e39477af1.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_b6f394fbdbebcdfa976ab82d0ca44a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb91d0>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_46303271176237fd3a764310a1d7cef3.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_79602c39b1385c67a70d4a3cfc6c5eeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_05f0a84102572486eff161a6a4be09db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05310>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_b6f394fbdbebcdfa976ab82d0ca44a97.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_c2b82343ea552425e6c9b1572420cee2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_0d0530698974499b60aeed6d3b88424f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b4d0>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_79602c39b1385c67a70d4a3cfc6c5eeb.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e9510>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_05f0a84102572486eff161a6a4be09db.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_6b3c9ea26cfc29563f38f71376062956.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_54a95b12a5b37511aa07845e39477af1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09250>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_c2b82343ea552425e6c9b1572420cee2.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300af810>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_0d0530698974499b60aeed6d3b88424f.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_4b614788e8d87b594275f9a20f0a695f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bcc10>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_6b3c9ea26cfc29563f38f71376062956.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e17890>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_54a95b12a5b37511aa07845e39477af1.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eab390>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_4b614788e8d87b594275f9a20f0a695f.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_5deee78b8ccc3d4fe9194c8201bc9ed3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_1464ebaae5f5e414b1d0ce6e7819cb77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289410>
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_5deee78b8ccc3d4fe9194c8201bc9ed3.jpg saved to cache
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb83144a-4228-5871-9d7e-f58becb68b93
2026-04-27 08:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb83144a-4228-5871-9d7e-f58becb68b93, skipping ID generation
2026-04-27 08:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb83144a-4228-5871-9d7e-f58becb68b93 with scrape type 1
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb83144a-4228-5871-9d7e-f58becb68b93 sending to next pipeline
2026-04-27 08:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb83144a-4228-5871-9d7e-f58becb68b93, identifier: NK69314
2026-04-27 08:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb83144a-4228-5871-9d7e-f58becb68b93 with identifier: NK69314
2026-04-27 08:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb83144a-4228-5871-9d7e-f58becb68b93 with identifier: NK69314
2026-04-27 08:04:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb83144a-4228-5871-9d7e-f58becb68b93 with identifier: NK69314 to the API
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_5deee78b8ccc3d4fe9194c8201bc9ed3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Schkopau',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:36:06Z',
 'fuel_type': 'diesel',
 'id': 'eb83144a-4228-5871-9d7e-f58becb68b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK69314',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 225338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_4b614788e8d87b594275f9a20f0a695f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_46303271176237fd3a764310a1d7cef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_b6f394fbdbebcdfa976ab82d0ca44a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_5deee78b8ccc3d4fe9194c8201bc9ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_6b3c9ea26cfc29563f38f71376062956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_05f0a84102572486eff161a6a4be09db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_79602c39b1385c67a70d4a3cfc6c5eeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_0d0530698974499b60aeed6d3b88424f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_c2b82343ea552425e6c9b1572420cee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb83144a-4228-5871-9d7e-f58becb68b93/eb83144a-4228-5871-9d7e-f58becb68b93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66ecee400b4714ecd111bf44dd0f340/pa/NK69314_54a95b12a5b37511aa07845e39477af1.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-04-27 08:04:35 [auto1.de] INFO: Saving data for NK69314: {'created_time': 1777277075.506016, 'last_price_update_time': 1777277075.506026, 'has_photos': True, 'auction_closing_time': 1777390566.0}
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_b14c391eec8071fabfda996258db4368.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_cf79c4bc7c89acc28049aef21e3494b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c1c90>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_1464ebaae5f5e414b1d0ce6e7819cb77.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_249a076b4d47a853cf33e17f7a4f022f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f685d0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_b14c391eec8071fabfda996258db4368.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_318ae96505616a42157728440f1a963d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d9890>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_cf79c4bc7c89acc28049aef21e3494b0.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b74950>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_249a076b4d47a853cf33e17f7a4f022f.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7d459ad8a3696c5307579dd940c6ca57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_4d0c38b28ce515c48be926bee09ede45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026d4d0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_318ae96505616a42157728440f1a963d.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7ee0b858127281c1ab398c14ad395bb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_90af7d69e9fd76581c4cb5cc8d332404.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300acd10>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7d459ad8a3696c5307579dd940c6ca57.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_01d62322d4d628938936d08ea06b7327.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b053d0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_4d0c38b28ce515c48be926bee09ede45.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e
2026-04-27 08:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e, skipping ID generation
2026-04-27 08:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with scrape type 1
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e sending to next pipeline
2026-04-27 08:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e, identifier: FZ65862
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-04-27 08:04:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862 to the API
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_4d0c38b28ce515c48be926bee09ede45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'city': 'Erbach',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:32:41Z',
 'fuel_type': 'petrol',
 'id': 'e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ65862',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 159731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_249a076b4d47a853cf33e17f7a4f022f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_4d0c38b28ce515c48be926bee09ede45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_eae1bafc30914b222b08a94b632e3460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_cf79c4bc7c89acc28049aef21e3494b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_b14c391eec8071fabfda996258db4368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_1464ebaae5f5e414b1d0ce6e7819cb77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_795257393631090ac737c6e5f822b158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_813df8fb58bf076bdff1cae006c3414b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_22ae2f62f44cb448457e52768bc8fccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e/e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/ea/d2ea5e96d6332ac6c8f28e97fa5e6247/pa/FZ65862_c7973a76e3b4cc32de7848c27c00e2ec.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2010-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 300 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-04-27 08:04:36 [auto1.de] INFO: Saving data for FZ65862: {'created_time': 1777277076.399411, 'last_price_update_time': 1777277076.399421, 'has_photos': True, 'auction_closing_time': 1777390361.0}
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_08ff077751eb45c0e01c66a4c17032ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_a24f74c2fe79508805311b741137ce59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159910>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7ee0b858127281c1ab398c14ad395bb0.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cea50>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_90af7d69e9fd76581c4cb5cc8d332404.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67790>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_01d62322d4d628938936d08ea06b7327.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2ff90>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_08ff077751eb45c0e01c66a4c17032ca.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a8750>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_a24f74c2fe79508805311b741137ce59.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_88c0e695b709a31d5f8c708a602264eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_615216fd239b51b5a077a252c178a06b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301aab50>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_88c0e695b709a31d5f8c708a602264eb.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e23d0>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_615216fd239b51b5a077a252c178a06b.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35
2026-04-27 08:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35, skipping ID generation
2026-04-27 08:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with scrape type 1
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 sending to next pipeline
2026-04-27 08:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35, identifier: TM06775
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with identifier: TM06775
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with identifier: TM06775
2026-04-27 08:04:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5eca6b53-2d7e-56bb-9623-5b486e4e1f35 with identifier: TM06775 to the API
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_615216fd239b51b5a077a252c178a06b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'city': 'Kerpen',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:06:43Z',
 'fuel_type': 'petrol',
 'id': '5eca6b53-2d7e-56bb-9623-5b486e4e1f35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM06775',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 76544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_88c0e695b709a31d5f8c708a602264eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_615216fd239b51b5a077a252c178a06b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_08ff077751eb45c0e01c66a4c17032ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_01d62322d4d628938936d08ea06b7327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_a24f74c2fe79508805311b741137ce59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_90af7d69e9fd76581c4cb5cc8d332404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7ee0b858127281c1ab398c14ad395bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_7d459ad8a3696c5307579dd940c6ca57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_318ae96505616a42157728440f1a963d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5eca6b53-2d7e-56bb-9623-5b486e4e1f35/5eca6b53-2d7e-56bb-9623-5b486e4e1f35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/af/1dafdff130a4cb0df3951b5921cdec10/pa/TM06775_1f60810412749d9ca14375a80f113f39.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-11-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'manual',
 'trim': 'Basis Prime',
 'year': 2018}
2026-04-27 08:04:37 [auto1.de] INFO: Saving data for TM06775: {'created_time': 1777277077.34406, 'last_price_update_time': 1777277077.344073, 'has_photos': True, 'auction_closing_time': 1777388803.0}
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP67168/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP48685> (referer: https://www.auto1.com/v1/car-details-view/CP48685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6d22eb-b622-5b77-baf1-45e41d115c27 with identifier: CP48685
2026-04-27 08:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6d22eb-b622-5b77-baf1-45e41d115c27 with scrape type 1
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_617ad48567f625b7891813cd1fb5685a.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_cedf6a9e3446ca63bcb514332ee6e4c2.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f454305b99cdb265cec6802775897f9f.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f623eb28eb7d2bc6352fb1020b39d593.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_270953a30bb85986c898642080883da3.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_76a1e7b1e4debc610319905b631f1f7f.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_eb761fb5f7f97b6675286dae18974d64.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_86297242bf3b97c1e92de7f4bdd582c4.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_5a113cb48023b096437c3bbff632ee7e.jpg not downloaded yet
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_55a638e66d58b6bced5862cdcdb862d6.jpg not downloaded yet
2026-04-27 08:04:43 [scrapy.extensions.logstats] INFO: Crawled 534 pages (at 30 pages/min), scraped 235 items (at 18 items/min)
2026-04-27 08:04:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ21826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG62730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_55a638e66d58b6bced5862cdcdb862d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5090>
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_55a638e66d58b6bced5862cdcdb862d6.jpg saved to cache
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX06150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_5a113cb48023b096437c3bbff632ee7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c450>
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_5a113cb48023b096437c3bbff632ee7e.jpg saved to cache
2026-04-27 08:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE46966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_86297242bf3b97c1e92de7f4bdd582c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb90d0>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_86297242bf3b97c1e92de7f4bdd582c4.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD63966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_eb761fb5f7f97b6675286dae18974d64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eab4d0>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_eb761fb5f7f97b6675286dae18974d64.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK54006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_76a1e7b1e4debc610319905b631f1f7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2390>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_76a1e7b1e4debc610319905b631f1f7f.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM97001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_270953a30bb85986c898642080883da3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2f490>
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_270953a30bb85986c898642080883da3.jpg saved to cache
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM35795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f623eb28eb7d2bc6352fb1020b39d593.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6ab90>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f623eb28eb7d2bc6352fb1020b39d593.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY85636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f454305b99cdb265cec6802775897f9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f45d0>
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f454305b99cdb265cec6802775897f9f.jpg saved to cache
2026-04-27 08:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK90168> (referer: https://www.auto1.com/v1/car-details-view/JK90168/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-04-27 08:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79ee45a-2774-58de-a0ea-31f9c153bdd9 with scrape type 1
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_ab6cbc99a802e5329a6632378f36ea14.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_665902acf9fe258ff1ece46239ee6421.jpg not downloaded yet
2026-04-27 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_cedf6a9e3446ca63bcb514332ee6e4c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8a4a28490110995eadf1888ac0a8bec1.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8540023720e4c862fcf7b92be3e6fa28.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_63ad3349af72f753ec96918abdb2b3ba.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_c6fe167750587f94175f84410ce58310.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_f84d16aee9550f18e489c50a341732e4.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_7da2beb226774620c83c57eaabedac71.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_041af437a5d925ed99b9d57426a708c2.jpg not downloaded yet
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_0ed091f305877719888f057e7687fde2.jpg not downloaded yet
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93790>
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_cedf6a9e3446ca63bcb514332ee6e4c2.jpg saved to cache
2026-04-27 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_665902acf9fe258ff1ece46239ee6421.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb0850>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_665902acf9fe258ff1ece46239ee6421.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_0ed091f305877719888f057e7687fde2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006c250>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_0ed091f305877719888f057e7687fde2.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_041af437a5d925ed99b9d57426a708c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d79e90>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_041af437a5d925ed99b9d57426a708c2.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_7da2beb226774620c83c57eaabedac71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016f8d0>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_7da2beb226774620c83c57eaabedac71.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_f84d16aee9550f18e489c50a341732e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016ef10>
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_f84d16aee9550f18e489c50a341732e4.jpg saved to cache
2026-04-27 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_c6fe167750587f94175f84410ce58310.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cecd0>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_c6fe167750587f94175f84410ce58310.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_63ad3349af72f753ec96918abdb2b3ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167d50>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_63ad3349af72f753ec96918abdb2b3ba.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8540023720e4c862fcf7b92be3e6fa28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291efd0>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8540023720e4c862fcf7b92be3e6fa28.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8a4a28490110995eadf1888ac0a8bec1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_ab6cbc99a802e5329a6632378f36ea14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_617ad48567f625b7891813cd1fb5685a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb8fd0>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8a4a28490110995eadf1888ac0a8bec1.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f66e50>
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_ab6cbc99a802e5329a6632378f36ea14.jpg saved to cache
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a79ee45a-2774-58de-a0ea-31f9c153bdd9
2026-04-27 08:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a79ee45a-2774-58de-a0ea-31f9c153bdd9, skipping ID generation
2026-04-27 08:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79ee45a-2774-58de-a0ea-31f9c153bdd9 with scrape type 1
2026-04-27 08:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a79ee45a-2774-58de-a0ea-31f9c153bdd9 sending to next pipeline
2026-04-27 08:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a79ee45a-2774-58de-a0ea-31f9c153bdd9, identifier: JK90168
2026-04-27 08:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-04-27 08:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-04-27 08:05:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168 to the API
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_ab6cbc99a802e5329a6632378f36ea14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'city': 'Hattingen',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:28:19Z',
 'fuel_type': 'diesel',
 'id': 'a79ee45a-2774-58de-a0ea-31f9c153bdd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK90168',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 207533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_ab6cbc99a802e5329a6632378f36ea14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_665902acf9fe258ff1ece46239ee6421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8a4a28490110995eadf1888ac0a8bec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_8540023720e4c862fcf7b92be3e6fa28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_63ad3349af72f753ec96918abdb2b3ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_c6fe167750587f94175f84410ce58310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_f84d16aee9550f18e489c50a341732e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_7da2beb226774620c83c57eaabedac71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_041af437a5d925ed99b9d57426a708c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a79ee45a-2774-58de-a0ea-31f9c153bdd9/a79ee45a-2774-58de-a0ea-31f9c153bdd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/41/2d419c8a6e3f849fe292ea3024cc8e20/pa/JK90168_0ed091f305877719888f057e7687fde2.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-04-27 08:05:13 [auto1.de] INFO: Saving data for JK90168: {'created_time': 1777277113.268256, 'last_price_update_time': 1777277113.268266, 'has_photos': True, 'auction_closing_time': 1777390099.0}
2026-04-27 08:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed1b90>
2026-04-27 08:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_617ad48567f625b7891813cd1fb5685a.jpg saved to cache
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d6d22eb-b622-5b77-baf1-45e41d115c27
2026-04-27 08:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d6d22eb-b622-5b77-baf1-45e41d115c27, skipping ID generation
2026-04-27 08:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6d22eb-b622-5b77-baf1-45e41d115c27 with scrape type 1
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d6d22eb-b622-5b77-baf1-45e41d115c27 sending to next pipeline
2026-04-27 08:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d6d22eb-b622-5b77-baf1-45e41d115c27, identifier: CP48685
2026-04-27 08:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d6d22eb-b622-5b77-baf1-45e41d115c27 with identifier: CP48685
2026-04-27 08:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d6d22eb-b622-5b77-baf1-45e41d115c27 with identifier: CP48685
2026-04-27 08:05:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d6d22eb-b622-5b77-baf1-45e41d115c27 with identifier: CP48685 to the API
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_617ad48567f625b7891813cd1fb5685a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Germersheim',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 84,
 'expiration_date': '2026-04-28T15:16:29Z',
 'fuel_type': 'petrol',
 'id': '7d6d22eb-b622-5b77-baf1-45e41d115c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP48685',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 6490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_617ad48567f625b7891813cd1fb5685a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_cedf6a9e3446ca63bcb514332ee6e4c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f454305b99cdb265cec6802775897f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_f623eb28eb7d2bc6352fb1020b39d593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_270953a30bb85986c898642080883da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_76a1e7b1e4debc610319905b631f1f7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_eb761fb5f7f97b6675286dae18974d64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_86297242bf3b97c1e92de7f4bdd582c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_5a113cb48023b096437c3bbff632ee7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7d6d22eb-b622-5b77-baf1-45e41d115c27/7d6d22eb-b622-5b77-baf1-45e41d115c27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/55/1255fb4d3b3d1e08573dfdc1d11ca3fc/pa/CP48685_55a638e66d58b6bced5862cdcdb862d6.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2022}
2026-04-27 08:05:13 [auto1.de] INFO: Saving data for CP48685: {'created_time': 1777277113.780596, 'last_price_update_time': 1777277113.780607, 'has_photos': True, 'auction_closing_time': 1777389389.0}
2026-04-27 08:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG62730> (referer: https://www.auto1.com/v1/car-details-view/LG62730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-04-27 08:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 1
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg not downloaded yet
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg not downloaded yet
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg not downloaded yet
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg not downloaded yet
2026-04-27 08:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg not downloaded yet
2026-04-27 08:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg not downloaded yet
2026-04-27 08:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg not downloaded yet
2026-04-27 08:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg not downloaded yet
2026-04-27 08:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg not downloaded yet
2026-04-27 08:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg not downloaded yet
2026-04-27 08:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX06150> (referer: https://www.auto1.com/v1/car-details-view/LX06150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93085568-54c6-5449-863e-59506106ff1b with identifier: LX06150
2026-04-27 08:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93085568-54c6-5449-863e-59506106ff1b with scrape type 1
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5185412cc72b690e02d62d367b93cada.jpg not downloaded yet
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_1d1ba58d252944a4fe77b3626f43dcff.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_63a5ade1264e756331d08c729c8889fc.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_3e656b09ac94102577dddfa0ec20326b.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_55f6380fe33e95861176472764036566.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_598149186e56caebcb798e87306c9a03.jpg not downloaded yet
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5185412cc72b690e02d62d367b93cada.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_8d0b4fda76bea7872a4cb6f4a62f005d.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_d502c1b34896d4328e506fab0cf58422.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5072283da8ed51ef62ada363d196ec81.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_54976f84351fa5e0c36c395f826a7b4a.jpg not downloaded yet
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ccad0>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6a2d0>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5185412cc72b690e02d62d367b93cada.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_598149186e56caebcb798e87306c9a03.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64350>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_598149186e56caebcb798e87306c9a03.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_54976f84351fa5e0c36c395f826a7b4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5072283da8ed51ef62ada363d196ec81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3690>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_54976f84351fa5e0c36c395f826a7b4a.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_d502c1b34896d4328e506fab0cf58422.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cee510>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5072283da8ed51ef62ada363d196ec81.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2f390>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_d502c1b34896d4328e506fab0cf58422.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_8d0b4fda76bea7872a4cb6f4a62f005d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2d4d0>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_8d0b4fda76bea7872a4cb6f4a62f005d.jpg saved to cache
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_55f6380fe33e95861176472764036566.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_3e656b09ac94102577dddfa0ec20326b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e69610>
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_55f6380fe33e95861176472764036566.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09f10>
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_3e656b09ac94102577dddfa0ec20326b.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_63a5ade1264e756331d08c729c8889fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_1d1ba58d252944a4fe77b3626f43dcff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e9d0>
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_63a5ade1264e756331d08c729c8889fc.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0b5d0>
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_1d1ba58d252944a4fe77b3626f43dcff.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93085568-54c6-5449-863e-59506106ff1b
2026-04-27 08:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93085568-54c6-5449-863e-59506106ff1b, skipping ID generation
2026-04-27 08:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93085568-54c6-5449-863e-59506106ff1b with scrape type 1
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93085568-54c6-5449-863e-59506106ff1b sending to next pipeline
2026-04-27 08:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93085568-54c6-5449-863e-59506106ff1b, identifier: LX06150
2026-04-27 08:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93085568-54c6-5449-863e-59506106ff1b with identifier: LX06150
2026-04-27 08:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93085568-54c6-5449-863e-59506106ff1b with identifier: LX06150
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93085568-54c6-5449-863e-59506106ff1b with identifier: LX06150 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_1d1ba58d252944a4fe77b3626f43dcff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Lahr',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:51:12Z',
 'fuel_type': 'diesel',
 'id': '93085568-54c6-5449-863e-59506106ff1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.9333,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX06150',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'location_confidence': 'geocoded',
 'longitude': 6.2833,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 188071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5185412cc72b690e02d62d367b93cada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_1d1ba58d252944a4fe77b3626f43dcff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_63a5ade1264e756331d08c729c8889fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_3e656b09ac94102577dddfa0ec20326b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_55f6380fe33e95861176472764036566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_598149186e56caebcb798e87306c9a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_8d0b4fda76bea7872a4cb6f4a62f005d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_d502c1b34896d4328e506fab0cf58422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_5072283da8ed51ef62ada363d196ec81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93085568-54c6-5449-863e-59506106ff1b/93085568-54c6-5449-863e-59506106ff1b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/19/ea19679acd7e0e54485c89ca875d817d/pa/LX06150_54976f84351fa5e0c36c395f826a7b4a.jpg',
             'Width': 800}],
 'postal_code': '54675',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2015-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-04-27 08:05:24 [auto1.de] INFO: Saving data for LX06150: {'created_time': 1777277124.056983, 'last_price_update_time': 1777277124.056994, 'has_photos': True, 'auction_closing_time': 1777391472.0}
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65a10>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291e390>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a35390>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f0f2710>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed32d0>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30052750>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2d390>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da22d0>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ21826> (referer: https://www.auto1.com/v1/car-details-view/ZZ21826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302888d0>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, skipping ID generation
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 sending to next pipeline
2026-04-27 08:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, identifier: LG62730
2026-04-27 08:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-04-27 08:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-04-27 08:05:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730 to the API
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Hattingen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:55:15Z',
 'fuel_type': 'diesel',
 'id': '7c51b62c-b60d-5b31-ab3f-a150e7de0a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG62730',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 146872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2018}
2026-04-27 08:05:25 [auto1.de] INFO: Saving data for LG62730: {'created_time': 1777277125.767253, 'last_price_update_time': 1777277125.767266, 'has_photos': True, 'auction_closing_time': 1777391715.0}
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24988fcd-7d66-58e7-bd10-da2b0099b329 with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_a81ed3c8fdbda87b4e999daeabc98f84.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_caac60f8fe8554e73d8d887e35af46cf.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_63dacc3c479af41ce0de117f7ad395cb.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_0d5a439ce72cf4c52960d3ea2793ac85.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_085353e9884033e2d19e633ce8d91436.jpg not downloaded yet
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU93534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_085353e9884033e2d19e633ce8d91436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f0f2f10>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_085353e9884033e2d19e633ce8d91436.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_0d5a439ce72cf4c52960d3ea2793ac85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028b4d0>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_0d5a439ce72cf4c52960d3ea2793ac85.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD63966> (referer: https://www.auto1.com/v1/car-details-view/LD63966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 1
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_3b10c0fef0294f6808abf1281b2ddb3b.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_851301860c1c8544bf3b8cf3db9ab91b.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_0a8769717c0b88dcf969b08232b046da.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_5681e0dfb59fb4d687a1a889261e8903.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_02242e5d01fbc730d81774ab8ab52d05.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_4595f93a0eda0d36732f60be1cb24457.jpg not downloaded yet
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_63dacc3c479af41ce0de117f7ad395cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_b10928ac8bfd3f7388f0a9b4c8fee32c.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_c4ab9a8fc342754b3bdcd35f78d0eb4f.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_75521345579ec49f0501587eef74e020.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_103e943d69457d2c5adff410ba257fe2.jpg not downloaded yet
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f73d0>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_63dacc3c479af41ce0de117f7ad395cb.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_4595f93a0eda0d36732f60be1cb24457.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cecd10>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_4595f93a0eda0d36732f60be1cb24457.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_103e943d69457d2c5adff410ba257fe2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3cd90>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_103e943d69457d2c5adff410ba257fe2.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_75521345579ec49f0501587eef74e020.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cec590>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_75521345579ec49f0501587eef74e020.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_c4ab9a8fc342754b3bdcd35f78d0eb4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd9f10>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_c4ab9a8fc342754b3bdcd35f78d0eb4f.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_b10928ac8bfd3f7388f0a9b4c8fee32c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289590>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_b10928ac8bfd3f7388f0a9b4c8fee32c.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_02242e5d01fbc730d81774ab8ab52d05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167850>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_02242e5d01fbc730d81774ab8ab52d05.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_5681e0dfb59fb4d687a1a889261e8903.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67810>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_5681e0dfb59fb4d687a1a889261e8903.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_0a8769717c0b88dcf969b08232b046da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb39d0>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_0a8769717c0b88dcf969b08232b046da.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_851301860c1c8544bf3b8cf3db9ab91b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_3b10c0fef0294f6808abf1281b2ddb3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_caac60f8fe8554e73d8d887e35af46cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f51010>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_851301860c1c8544bf3b8cf3db9ab91b.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bb310>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_3b10c0fef0294f6808abf1281b2ddb3b.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb8396d4-9655-572c-8e63-09596ed21c7d
2026-04-27 08:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb8396d4-9655-572c-8e63-09596ed21c7d, skipping ID generation
2026-04-27 08:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 1
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb8396d4-9655-572c-8e63-09596ed21c7d sending to next pipeline
2026-04-27 08:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb8396d4-9655-572c-8e63-09596ed21c7d, identifier: LD63966
2026-04-27 08:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-04-27 08:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_3b10c0fef0294f6808abf1281b2ddb3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:58:20Z',
 'fuel_type': 'petrol',
 'id': 'cb8396d4-9655-572c-8e63-09596ed21c7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD63966',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 68954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_3b10c0fef0294f6808abf1281b2ddb3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_851301860c1c8544bf3b8cf3db9ab91b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_0a8769717c0b88dcf969b08232b046da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_5681e0dfb59fb4d687a1a889261e8903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_02242e5d01fbc730d81774ab8ab52d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_4595f93a0eda0d36732f60be1cb24457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_b10928ac8bfd3f7388f0a9b4c8fee32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_c4ab9a8fc342754b3bdcd35f78d0eb4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_75521345579ec49f0501587eef74e020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb8396d4-9655-572c-8e63-09596ed21c7d/cb8396d4-9655-572c-8e63-09596ed21c7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/d8/16d8400ef236ffb745188153d7c3d9df/pa/LD63966_103e943d69457d2c5adff410ba257fe2.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2018-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-04-27 08:05:32 [auto1.de] INFO: Saving data for LD63966: {'created_time': 1777277132.55215, 'last_price_update_time': 1777277132.552161, 'has_photos': True, 'auction_closing_time': 1777391900.0}
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_a81ed3c8fdbda87b4e999daeabc98f84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0a490>
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_caac60f8fe8554e73d8d887e35af46cf.jpg saved to cache
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cee250>
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_a81ed3c8fdbda87b4e999daeabc98f84.jpg saved to cache
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24988fcd-7d66-58e7-bd10-da2b0099b329
2026-04-27 08:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24988fcd-7d66-58e7-bd10-da2b0099b329, skipping ID generation
2026-04-27 08:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24988fcd-7d66-58e7-bd10-da2b0099b329 with scrape type 1
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24988fcd-7d66-58e7-bd10-da2b0099b329 sending to next pipeline
2026-04-27 08:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24988fcd-7d66-58e7-bd10-da2b0099b329, identifier: ZZ21826
2026-04-27 08:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-04-27 08:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_a81ed3c8fdbda87b4e999daeabc98f84.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Überherrn',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.1L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:25:44Z',
 'fuel_type': 'diesel',
 'id': '24988fcd-7d66-58e7-bd10-da2b0099b329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ21826',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 162182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_a81ed3c8fdbda87b4e999daeabc98f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_caac60f8fe8554e73d8d887e35af46cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_63dacc3c479af41ce0de117f7ad395cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_0d5a439ce72cf4c52960d3ea2793ac85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24988fcd-7d66-58e7-bd10-da2b0099b329/24988fcd-7d66-58e7-bd10-da2b0099b329_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e5/71e5aa6311aa282dd6811ad00df7445f/pa/ZZ21826_085353e9884033e2d19e633ce8d91436.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2006-06-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2006}
2026-04-27 08:05:33 [auto1.de] INFO: Saving data for ZZ21826: {'created_time': 1777277133.159528, 'last_price_update_time': 1777277133.15954, 'has_photos': True, 'auction_closing_time': 1777389944.0}
2026-04-27 08:05:43 [scrapy.extensions.logstats] INFO: Crawled 549 pages (at 15 pages/min), scraped 241 items (at 6 items/min)
2026-04-27 08:05:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.637(s), this was the 1st time calling it.
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.828727024612187 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.642(s), this was the 1st time calling it.
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.975221969249974 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA60323> (referer: https://www.auto1.com/v1/car-details-view/CA60323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4abc7bf-3e47-5c54-95bc-24d94a326aac with identifier: CA60323
2026-04-27 08:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4abc7bf-3e47-5c54-95bc-24d94a326aac with scrape type 1
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_25c0c561fb5a25dfa24a9bf4cc3a39d3.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_f9a559b47b8089284564659761cc0313.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_49e7f79baf7eac09f10b7f979949e5c9.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_2728b2efe8cd3d98522173aa601282b8.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_450ef7995105f549e12dc64a3cdb701d.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_0e3058b3b58fe14d2497518e0deebda1.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_42d73c115ca9902e0e5811a6658c5757.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_4da7e8f8d0fad9a7aafebec0837c1475.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_ddbfaf465e8ba08384a0fac8a59acaaf.jpg not downloaded yet
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_862c041f47a28e124f7de16e1c36037b.jpg not downloaded yet
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM35795> (referer: https://www.auto1.com/v1/car-details-view/EM35795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96a2787-7674-5708-b434-76fc15e743da with identifier: EM35795
2026-04-27 08:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96a2787-7674-5708-b434-76fc15e743da with scrape type 1
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_e81d756088dc3d9e2d4d5fbd766fffae.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_65aeadfbe1020a94f9e8a6e6a2916dac.jpg not downloaded yet
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_862c041f47a28e124f7de16e1c36037b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_c65bc932ee78bfe4563171e17927fa3d.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_3a8f079d9d1e03727db5efaf7508fff4.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_8d995e79dea842c82ea97085f57c2462.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_9c641e4d75c776e98038e5cdbad36a81.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_264af92d28070cfd88aa2e7a4d68117b.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_b530402426c93ccc3c1e703695ac3393.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_479097db4821e29ed2608b4b57c0731f.jpg not downloaded yet
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_6a0c7e146b00856ea2104c0a70677b49.jpg not downloaded yet
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32098690>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_862c041f47a28e124f7de16e1c36037b.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_65aeadfbe1020a94f9e8a6e6a2916dac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5d9d0>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_65aeadfbe1020a94f9e8a6e6a2916dac.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_6a0c7e146b00856ea2104c0a70677b49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dc9d0>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_6a0c7e146b00856ea2104c0a70677b49.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_479097db4821e29ed2608b4b57c0731f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1e490>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_479097db4821e29ed2608b4b57c0731f.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_b530402426c93ccc3c1e703695ac3393.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5c390>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_b530402426c93ccc3c1e703695ac3393.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_264af92d28070cfd88aa2e7a4d68117b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd3a90>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_264af92d28070cfd88aa2e7a4d68117b.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_9c641e4d75c776e98038e5cdbad36a81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5c090>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_9c641e4d75c776e98038e5cdbad36a81.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_8d995e79dea842c82ea97085f57c2462.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30050bd0>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_8d995e79dea842c82ea97085f57c2462.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_3a8f079d9d1e03727db5efaf7508fff4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c1510>
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_3a8f079d9d1e03727db5efaf7508fff4.jpg saved to cache
2026-04-27 08:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_c65bc932ee78bfe4563171e17927fa3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_e81d756088dc3d9e2d4d5fbd766fffae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f1b210>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_c65bc932ee78bfe4563171e17927fa3d.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0d10>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_e81d756088dc3d9e2d4d5fbd766fffae.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c96a2787-7674-5708-b434-76fc15e743da
2026-04-27 08:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c96a2787-7674-5708-b434-76fc15e743da, skipping ID generation
2026-04-27 08:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96a2787-7674-5708-b434-76fc15e743da with scrape type 1
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c96a2787-7674-5708-b434-76fc15e743da sending to next pipeline
2026-04-27 08:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96a2787-7674-5708-b434-76fc15e743da, identifier: EM35795
2026-04-27 08:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96a2787-7674-5708-b434-76fc15e743da with identifier: EM35795
2026-04-27 08:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96a2787-7674-5708-b434-76fc15e743da with identifier: EM35795
2026-04-27 08:05:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96a2787-7674-5708-b434-76fc15e743da with identifier: EM35795 to the API
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_e81d756088dc3d9e2d4d5fbd766fffae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Zülpich',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:51:29Z',
 'fuel_type': 'petrol',
 'id': 'c96a2787-7674-5708-b434-76fc15e743da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM35795',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 86756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_e81d756088dc3d9e2d4d5fbd766fffae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_65aeadfbe1020a94f9e8a6e6a2916dac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_c65bc932ee78bfe4563171e17927fa3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_3a8f079d9d1e03727db5efaf7508fff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_8d995e79dea842c82ea97085f57c2462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_9c641e4d75c776e98038e5cdbad36a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_264af92d28070cfd88aa2e7a4d68117b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_b530402426c93ccc3c1e703695ac3393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_479097db4821e29ed2608b4b57c0731f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c96a2787-7674-5708-b434-76fc15e743da/c96a2787-7674-5708-b434-76fc15e743da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/59/5159b72ca70582e508be5a0669e84e12/pa/EM35795_6a0c7e146b00856ea2104c0a70677b49.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-04-27 08:05:55 [auto1.de] INFO: Saving data for EM35795: {'created_time': 1777277155.685455, 'last_price_update_time': 1777277155.685465, 'has_photos': True, 'auction_closing_time': 1777391489.0}
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_ddbfaf465e8ba08384a0fac8a59acaaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32089e50>
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_ddbfaf465e8ba08384a0fac8a59acaaf.jpg saved to cache
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_4da7e8f8d0fad9a7aafebec0837c1475.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22db6dd0>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_4da7e8f8d0fad9a7aafebec0837c1475.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_42d73c115ca9902e0e5811a6658c5757.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea8c50>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_42d73c115ca9902e0e5811a6658c5757.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_0e3058b3b58fe14d2497518e0deebda1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1010>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_0e3058b3b58fe14d2497518e0deebda1.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_450ef7995105f549e12dc64a3cdb701d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d210>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_450ef7995105f549e12dc64a3cdb701d.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_2728b2efe8cd3d98522173aa601282b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9da50>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_2728b2efe8cd3d98522173aa601282b8.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_49e7f79baf7eac09f10b7f979949e5c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY85636> (referer: https://www.auto1.com/v1/car-details-view/XY85636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_25c0c561fb5a25dfa24a9bf4cc3a39d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291c510>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_49e7f79baf7eac09f10b7f979949e5c9.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8af7ced-271b-520e-b946-d421a115ebb0 with identifier: XY85636
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af7ced-271b-520e-b946-d421a115ebb0 with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_20904da21946f6881df5c765c77fda6a.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_356b6fb2a8f8c1157eb088fe318dd164.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_89a7fa6d21af8a0ec4dc05d640ffd7d8.jpg not downloaded yet
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301cecd0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_25c0c561fb5a25dfa24a9bf4cc3a39d3.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_b9896bb3b0f5e3915549ff55bf48da58.jpg not downloaded yet
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_f9a559b47b8089284564659761cc0313.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_d69eef9f4bb7bb9ce43ce136b21f8112.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_886b1d832170b8ba1a22bed7b6471060.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_3943ae63584d916300413f50e9dd2ce1.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_4cf2e77b6c3dc83d754b59dc6948451d.jpg not downloaded yet
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_b9896bb3b0f5e3915549ff55bf48da58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_1d77e9f2005e2fd43b15942c11ea7a27.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_99ae933b11d11d360671e6207ab9a30f.jpg not downloaded yet
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14610>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_f9a559b47b8089284564659761cc0313.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4abc7bf-3e47-5c54-95bc-24d94a326aac
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4abc7bf-3e47-5c54-95bc-24d94a326aac, skipping ID generation
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4abc7bf-3e47-5c54-95bc-24d94a326aac with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4abc7bf-3e47-5c54-95bc-24d94a326aac sending to next pipeline
2026-04-27 08:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4abc7bf-3e47-5c54-95bc-24d94a326aac, identifier: CA60323
2026-04-27 08:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4abc7bf-3e47-5c54-95bc-24d94a326aac with identifier: CA60323
2026-04-27 08:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4abc7bf-3e47-5c54-95bc-24d94a326aac with identifier: CA60323
2026-04-27 08:05:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4abc7bf-3e47-5c54-95bc-24d94a326aac with identifier: CA60323 to the API
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_f9a559b47b8089284564659761cc0313.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:55:40Z',
 'fuel_type': 'petrol',
 'id': 'b4abc7bf-3e47-5c54-95bc-24d94a326aac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA60323',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 132758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_25c0c561fb5a25dfa24a9bf4cc3a39d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_f9a559b47b8089284564659761cc0313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_49e7f79baf7eac09f10b7f979949e5c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_2728b2efe8cd3d98522173aa601282b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_450ef7995105f549e12dc64a3cdb701d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_0e3058b3b58fe14d2497518e0deebda1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_42d73c115ca9902e0e5811a6658c5757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_4da7e8f8d0fad9a7aafebec0837c1475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_ddbfaf465e8ba08384a0fac8a59acaaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4abc7bf-3e47-5c54-95bc-24d94a326aac/b4abc7bf-3e47-5c54-95bc-24d94a326aac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/71/e971d948787026104cdcb6138335e49e/pa/CA60323_862c041f47a28e124f7de16e1c36037b.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-04-27 08:05:58 [auto1.de] INFO: Saving data for CA60323: {'created_time': 1777277158.117835, 'last_price_update_time': 1777277158.117853, 'has_photos': True, 'auction_closing_time': 1777391740.0}
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_4cf2e77b6c3dc83d754b59dc6948451d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU83477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37990>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_b9896bb3b0f5e3915549ff55bf48da58.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37750>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_4cf2e77b6c3dc83d754b59dc6948451d.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_1d77e9f2005e2fd43b15942c11ea7a27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_99ae933b11d11d360671e6207ab9a30f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_3943ae63584d916300413f50e9dd2ce1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e434d0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_1d77e9f2005e2fd43b15942c11ea7a27.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051590>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_99ae933b11d11d360671e6207ab9a30f.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ecda810>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_3943ae63584d916300413f50e9dd2ce1.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_886b1d832170b8ba1a22bed7b6471060.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_d69eef9f4bb7bb9ce43ce136b21f8112.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e689d0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_886b1d832170b8ba1a22bed7b6471060.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_89a7fa6d21af8a0ec4dc05d640ffd7d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9cb90>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_d69eef9f4bb7bb9ce43ce136b21f8112.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_356b6fb2a8f8c1157eb088fe318dd164.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_20904da21946f6881df5c765c77fda6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ae790>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_89a7fa6d21af8a0ec4dc05d640ffd7d8.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8b10>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_356b6fb2a8f8c1157eb088fe318dd164.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8b50>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_20904da21946f6881df5c765c77fda6a.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8af7ced-271b-520e-b946-d421a115ebb0
2026-04-27 08:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8af7ced-271b-520e-b946-d421a115ebb0, skipping ID generation
2026-04-27 08:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af7ced-271b-520e-b946-d421a115ebb0 with scrape type 1
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8af7ced-271b-520e-b946-d421a115ebb0 sending to next pipeline
2026-04-27 08:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8af7ced-271b-520e-b946-d421a115ebb0, identifier: XY85636
2026-04-27 08:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8af7ced-271b-520e-b946-d421a115ebb0 with identifier: XY85636
2026-04-27 08:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8af7ced-271b-520e-b946-d421a115ebb0 with identifier: XY85636
2026-04-27 08:05:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8af7ced-271b-520e-b946-d421a115ebb0 with identifier: XY85636 to the API
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_20904da21946f6881df5c765c77fda6a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'city': 'Dortmund',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:59:07Z',
 'fuel_type': 'diesel',
 'id': 'f8af7ced-271b-520e-b946-d421a115ebb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY85636',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 303746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_20904da21946f6881df5c765c77fda6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_356b6fb2a8f8c1157eb088fe318dd164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_89a7fa6d21af8a0ec4dc05d640ffd7d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_b9896bb3b0f5e3915549ff55bf48da58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_d69eef9f4bb7bb9ce43ce136b21f8112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_886b1d832170b8ba1a22bed7b6471060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_3943ae63584d916300413f50e9dd2ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_4cf2e77b6c3dc83d754b59dc6948451d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_1d77e9f2005e2fd43b15942c11ea7a27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8af7ced-271b-520e-b946-d421a115ebb0/f8af7ced-271b-520e-b946-d421a115ebb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/20/e72079194cb0e197ca7ec618511fa2dc/pa/XY85636_99ae933b11d11d360671e6207ab9a30f.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline 4Motion',
 'transmission': 'manual',
 'trim': 'Comfortline 4Motion',
 'year': 2014}
2026-04-27 08:05:59 [auto1.de] INFO: Saving data for XY85636: {'created_time': 1777277159.386727, 'last_price_update_time': 1777277159.386737, 'has_photos': True, 'auction_closing_time': 1777391947.0}
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE46966> (referer: https://www.auto1.com/v1/car-details-view/BE46966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg not downloaded yet
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN04464> (referer: https://www.auto1.com/v1/car-details-view/BN04464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e10dbf77-bc88-5bfe-b0f4-e464b333a2af with identifier: BN04464
2026-04-27 08:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af with scrape type 1
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d69b397977c7025b61ab06d2531e4da8.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_79cfc19c75d9532be8c0c156dee1c793.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_60c486f05bdc51ab082460bcbfa85ada.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_00dd9ca02b24cb334654cafb4af3c9ee.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_5b9165537b2c823ea883817751f2a717.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_0f2e715ab2f5465bd459e49642bea7e9.jpg not downloaded yet
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_6f764b26d0c2b881b0d4f6392d2235c5.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_b5128f0dfb6c22bd7fd5895de9fb1f93.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d5fe78be4a0a88aa4514095e6057d58a.jpg not downloaded yet
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_4227b96dab8a70dd538bd86cc5f71b75.jpg not downloaded yet
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41cd0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_0f2e715ab2f5465bd459e49642bea7e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_4227b96dab8a70dd538bd86cc5f71b75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6afd0>
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_0f2e715ab2f5465bd459e49642bea7e9.jpg saved to cache
2026-04-27 08:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d614d0>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_4227b96dab8a70dd538bd86cc5f71b75.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d5fe78be4a0a88aa4514095e6057d58a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c0fd0>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d5fe78be4a0a88aa4514095e6057d58a.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_b5128f0dfb6c22bd7fd5895de9fb1f93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30053090>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_b5128f0dfb6c22bd7fd5895de9fb1f93.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_6f764b26d0c2b881b0d4f6392d2235c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f37650>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_6f764b26d0c2b881b0d4f6392d2235c5.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_5b9165537b2c823ea883817751f2a717.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebbef10>
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_5b9165537b2c823ea883817751f2a717.jpg saved to cache
2026-04-27 08:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_00dd9ca02b24cb334654cafb4af3c9ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e93650>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_00dd9ca02b24cb334654cafb4af3c9ee.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_60c486f05bdc51ab082460bcbfa85ada.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_79cfc19c75d9532be8c0c156dee1c793.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026fa10>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_60c486f05bdc51ab082460bcbfa85ada.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d69b397977c7025b61ab06d2531e4da8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005b690>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_79cfc19c75d9532be8c0c156dee1c793.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e42310>
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d69b397977c7025b61ab06d2531e4da8.jpg saved to cache
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af
2026-04-27 08:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e10dbf77-bc88-5bfe-b0f4-e464b333a2af, skipping ID generation
2026-04-27 08:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af with scrape type 1
2026-04-27 08:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e10dbf77-bc88-5bfe-b0f4-e464b333a2af sending to next pipeline
2026-04-27 08:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e10dbf77-bc88-5bfe-b0f4-e464b333a2af, identifier: BN04464
2026-04-27 08:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e10dbf77-bc88-5bfe-b0f4-e464b333a2af with identifier: BN04464
2026-04-27 08:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e10dbf77-bc88-5bfe-b0f4-e464b333a2af with identifier: BN04464
2026-04-27 08:06:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e10dbf77-bc88-5bfe-b0f4-e464b333a2af with identifier: BN04464 to the API
2026-04-27 08:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d69b397977c7025b61ab06d2531e4da8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'city': 'Karlskron',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:55:33Z',
 'fuel_type': 'petrol',
 'id': 'e10dbf77-bc88-5bfe-b0f4-e464b333a2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN04464',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 72242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d69b397977c7025b61ab06d2531e4da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_79cfc19c75d9532be8c0c156dee1c793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_60c486f05bdc51ab082460bcbfa85ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_00dd9ca02b24cb334654cafb4af3c9ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_5b9165537b2c823ea883817751f2a717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_0f2e715ab2f5465bd459e49642bea7e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_6f764b26d0c2b881b0d4f6392d2235c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_b5128f0dfb6c22bd7fd5895de9fb1f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_d5fe78be4a0a88aa4514095e6057d58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10dbf77-bc88-5bfe-b0f4-e464b333a2af/e10dbf77-bc88-5bfe-b0f4-e464b333a2af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ac/b4ac4132172451ad1086c77503563c79/pa/BN04464_4227b96dab8a70dd538bd86cc5f71b75.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2013-06-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-04-27 08:06:04 [auto1.de] INFO: Saving data for BN04464: {'created_time': 1777277164.132087, 'last_price_update_time': 1777277164.132098, 'has_photos': True, 'auction_closing_time': 1777391733.0}
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41ed0>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0e610>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce9710>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c3890>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdac10>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41650>
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg saved to cache
2026-04-27 08:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cee4d0>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43590>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK54006> (referer: https://www.auto1.com/v1/car-details-view/WK54006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026f290>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-04-27 08:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6c393d5-69d3-5a3f-92a0-ca03f32db445, skipping ID generation
2026-04-27 08:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 1
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 sending to next pipeline
2026-04-27 08:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c393d5-69d3-5a3f-92a0-ca03f32db445, identifier: BE46966
2026-04-27 08:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-04-27 08:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-04-27 08:06:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966 to the API
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Hemau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:09:21Z',
 'fuel_type': 'diesel',
 'id': 'a6c393d5-69d3-5a3f-92a0-ca03f32db445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0383,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE46966',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'location_confidence': 'geocoded',
 'longitude': 11.8522,
 'make': 'BMW',
 'model': '7er',
 'odometer': 234064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg',
             'Width': 800}],
 'postal_code': '93155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Palatinate',
 'province_code': 'DE-093',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-04-27 08:06:05 [auto1.de] INFO: Saving data for BE46966: {'created_time': 1777277165.786873, 'last_price_update_time': 1777277165.786883, 'has_photos': True, 'auction_closing_time': 1777388961.0}
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_99f441227db8d1f87f62d17ed0a41ba4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-04-27 08:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b with scrape type 1
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_f9c2d603b2672c382196f0f4a3f4938b.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_fad356bfd34cefdebfebe4b86b80874d.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_96052ec7dc4fa580dd6f929f2757a4b8.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_0bb5e5f2e88b1828cec39214a0c44237.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_e26af59a7e94dfa0e5003e43a596b1bf.jpg not downloaded yet
2026-04-27 08:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_b59e99e14ee5c60a1b81f0fac10e3e4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_08f80423e7d211dc2e2d9b4839d72645.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_aff8ceec966af3095dfb130a63ed5603.jpg not downloaded yet
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_5b19fd29af497ac3b16b0b7c39ba452f.jpg not downloaded yet
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d61d90>
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_99f441227db8d1f87f62d17ed0a41ba4.jpg saved to cache
2026-04-27 08:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_ced7b89da33d284396a8c4160de88150.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_a9b4572a8218f54e49acb081336451c1.jpg not downloaded yet
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301fba10>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_b59e99e14ee5c60a1b81f0fac10e3e4c.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d
2026-04-27 08:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f25b0ed4-b2b0-5977-919b-05d0ec3de59d, skipping ID generation
2026-04-27 08:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 1
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d sending to next pipeline
2026-04-27 08:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25b0ed4-b2b0-5977-919b-05d0ec3de59d, identifier: PC54286
2026-04-27 08:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-04-27 08:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-04-27 08:06:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286 to the API
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_b59e99e14ee5c60a1b81f0fac10e3e4c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'city': 'Zörbig',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-04-28T15:31:38Z',
 'fuel_type': 'petrol',
 'id': 'f25b0ed4-b2b0-5977-919b-05d0ec3de59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.6289,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC54286',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'location_confidence': 'geocoded',
 'longitude': 12.1174,
 'make': 'BMW',
 'model': '3er',
 'odometer': 209350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_b59e99e14ee5c60a1b81f0fac10e3e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_86a0d156ad0d3c882f6b7e442038c817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_99f441227db8d1f87f62d17ed0a41ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_4247e6e9dfa73c7c275f99b5117be19b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_d35c83940aeaa468bed6efbb6407094b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f25b0ed4-b2b0-5977-919b-05d0ec3de59d/f25b0ed4-b2b0-5977-919b-05d0ec3de59d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ec/66ecc435bb4af1307ecadc763b138c50/pa/PC54286_07b209793c2e3ca10d19b9348af0e036.jpg',
             'Width': 800}],
 'postal_code': '06780',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2011-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-04-27 08:06:06 [auto1.de] INFO: Saving data for PC54286: {'created_time': 1777277166.448168, 'last_price_update_time': 1777277166.448177, 'has_photos': True, 'auction_closing_time': 1777390298.0}
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_0bb5e5f2e88b1828cec39214a0c44237.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM97001> (referer: https://www.auto1.com/v1/car-details-view/VM97001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_ced7b89da33d284396a8c4160de88150.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba6650>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_0bb5e5f2e88b1828cec39214a0c44237.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with identifier: VM97001
2026-04-27 08:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with scrape type 1
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_ee181bad8864f224ef7ece964e78a4e3.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_f7337ccc1e983aa08c1bec35403ce38e.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_8b4e85ef115d6bd2cb6f1838481dea18.jpg not downloaded yet
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2d9d0>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_ced7b89da33d284396a8c4160de88150.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_a9b4572a8218f54e49acb081336451c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_fc237b9d2252ae80ad3387a35256c08b.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_0851b2e03a9b6d515f479d06bab8a334.jpg not downloaded yet
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_5b19fd29af497ac3b16b0b7c39ba452f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_014f22a9d645d401c7069680c96b5b5d.jpg not downloaded yet
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY70267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_e892d9a44762d4f46e4975f86ddb803c.jpg not downloaded yet
2026-04-27 08:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_c28c4aa753c86a20b4873434a743d157.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_2ed0bc8ae4422ae424c83943b5fd66ae.jpg not downloaded yet
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_9330a7ee0207e167ed42d753f8e8244e.jpg not downloaded yet
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051310>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_a9b4572a8218f54e49acb081336451c1.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07fd0>
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_5b19fd29af497ac3b16b0b7c39ba452f.jpg saved to cache
2026-04-27 08:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_8b4e85ef115d6bd2cb6f1838481dea18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_014f22a9d645d401c7069680c96b5b5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_0851b2e03a9b6d515f479d06bab8a334.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300aca50>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_8b4e85ef115d6bd2cb6f1838481dea18.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2c950>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_014f22a9d645d401c7069680c96b5b5d.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2cb10>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_0851b2e03a9b6d515f479d06bab8a334.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_9330a7ee0207e167ed42d753f8e8244e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_2ed0bc8ae4422ae424c83943b5fd66ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed2610>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_9330a7ee0207e167ed42d753f8e8244e.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005b590>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_2ed0bc8ae4422ae424c83943b5fd66ae.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_c28c4aa753c86a20b4873434a743d157.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_e892d9a44762d4f46e4975f86ddb803c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026e410>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_c28c4aa753c86a20b4873434a743d157.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67ed0>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_e892d9a44762d4f46e4975f86ddb803c.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_fc237b9d2252ae80ad3387a35256c08b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_f7337ccc1e983aa08c1bec35403ce38e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_ee181bad8864f224ef7ece964e78a4e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3005b690>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_fc237b9d2252ae80ad3387a35256c08b.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5410>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_f7337ccc1e983aa08c1bec35403ce38e.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e490>
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_ee181bad8864f224ef7ece964e78a4e3.jpg saved to cache
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2
2026-04-27 08:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2, skipping ID generation
2026-04-27 08:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with scrape type 1
2026-04-27 08:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 sending to next pipeline
2026-04-27 08:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2, identifier: VM97001
2026-04-27 08:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with identifier: VM97001
2026-04-27 08:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with identifier: VM97001
2026-04-27 08:06:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10dfd86a-3466-50cf-9e2e-bb7de5c22ec2 with identifier: VM97001 to the API
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_ee181bad8864f224ef7ece964e78a4e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 248,
 'category': None,
 'city': 'Germersheim',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 255,
 'expiration_date': '2026-04-28T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '10dfd86a-3466-50cf-9e2e-bb7de5c22ec2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM97001',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Nissan',
 'model': 'Murano',
 'odometer': 161812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49348,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_ee181bad8864f224ef7ece964e78a4e3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42590,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_f7337ccc1e983aa08c1bec35403ce38e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46405,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_8b4e85ef115d6bd2cb6f1838481dea18.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46237,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_fc237b9d2252ae80ad3387a35256c08b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41709,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_0851b2e03a9b6d515f479d06bab8a334.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50369,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_014f22a9d645d401c7069680c96b5b5d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_e892d9a44762d4f46e4975f86ddb803c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55227,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_c28c4aa753c86a20b4873434a743d157.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52481,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_2ed0bc8ae4422ae424c83943b5fd66ae.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10dfd86a-3466-50cf-9e2e-bb7de5c22ec2/10dfd86a-3466-50cf-9e2e-bb7de5c22ec2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46160,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img07/40/0740659e62920052fa017c36dd46ecf1/pa/VM97001_9330a7ee0207e167ed42d753f8e8244e.jpg',
             'Width': 640}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2012-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Murano 3.5 V6 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2012}
2026-04-27 08:06:08 [auto1.de] INFO: Saving data for VM97001: {'created_time': 1777277168.442615, 'last_price_update_time': 1777277168.442628, 'has_photos': True, 'auction_closing_time': 1777391334.0}
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_aff8ceec966af3095dfb130a63ed5603.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_08f80423e7d211dc2e2d9b4839d72645.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b055d0>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_aff8ceec966af3095dfb130a63ed5603.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026d810>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_08f80423e7d211dc2e2d9b4839d72645.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_e26af59a7e94dfa0e5003e43a596b1bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_96052ec7dc4fa580dd6f929f2757a4b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_fad356bfd34cefdebfebe4b86b80874d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_f9c2d603b2672c382196f0f4a3f4938b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1dc10>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_e26af59a7e94dfa0e5003e43a596b1bf.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e75090>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_96052ec7dc4fa580dd6f929f2757a4b8.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9f9d0>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_fad356bfd34cefdebfebe4b86b80874d.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003c590>
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_f9c2d603b2672c382196f0f4a3f4938b.jpg saved to cache
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b
2026-04-27 08:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45934cc1-8ebd-518e-98b5-55f5adb51e3b, skipping ID generation
2026-04-27 08:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b with scrape type 1
2026-04-27 08:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b sending to next pipeline
2026-04-27 08:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45934cc1-8ebd-518e-98b5-55f5adb51e3b, identifier: WK54006
2026-04-27 08:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-04-27 08:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-04-27 08:06:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006 to the API
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_f9c2d603b2672c382196f0f4a3f4938b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Germersheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-04-28T15:19:05Z',
 'fuel_type': 'petrol',
 'id': '45934cc1-8ebd-518e-98b5-55f5adb51e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK54006',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 70328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_f9c2d603b2672c382196f0f4a3f4938b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_fad356bfd34cefdebfebe4b86b80874d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_96052ec7dc4fa580dd6f929f2757a4b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_0bb5e5f2e88b1828cec39214a0c44237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_e26af59a7e94dfa0e5003e43a596b1bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_08f80423e7d211dc2e2d9b4839d72645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_aff8ceec966af3095dfb130a63ed5603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_5b19fd29af497ac3b16b0b7c39ba452f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_ced7b89da33d284396a8c4160de88150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45934cc1-8ebd-518e-98b5-55f5adb51e3b/45934cc1-8ebd-518e-98b5-55f5adb51e3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eae9d51ff4293d61ff3019a405740/pa/WK54006_a9b4572a8218f54e49acb081336451c1.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2017-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-04-27 08:06:09 [auto1.de] INFO: Saving data for WK54006: {'created_time': 1777277169.360429, 'last_price_update_time': 1777277169.360438, 'has_photos': True, 'auction_closing_time': 1777389545.0}
2026-04-27 08:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY15259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM10383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.840(s), this was the 1st time calling it.
2026-04-27 08:06:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.958980542071148 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:43 [scrapy.extensions.logstats] INFO: Crawled 560 pages (at 11 pages/min), scraped 249 items (at 8 items/min)
2026-04-27 08:06:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.232(s), this was the 1st time calling it.
2026-04-27 08:07:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.729538988192575 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.024(s), this was the 1st time calling it.
2026-04-27 08:07:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.261846426637896 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE12481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL56937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU83477> (referer: https://www.auto1.com/v1/car-details-view/PU83477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with identifier: PU83477
2026-04-27 08:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with scrape type 1
2026-04-27 08:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_3bc4d2a482ddd99fe001a89fc36b8aa9.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_1cb5efca059ddc0f50dc739bf468c9d0.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_ece1fcc0259a7d5d133eef614bb35885.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_4e5c9fdce49e8d53bca0475774d671cc.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_7ffbeb3ec38df830c1fabf4974a70f14.jpg not downloaded yet
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP67168> (referer: https://www.auto1.com/v1/car-details-view/TP67168/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-04-27 08:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 1
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_da4f1f945b2e86523c0ffec4b946a14f.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_09351d663ecf672d69f0d21c6f715655.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8dfef0d538a26148165d6e9994ad3768.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_d811a78e5a10e9e4cb9fb266708f2db5.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_ec923ea0bd84497157bb140b23262828.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8e9fd5ab363dbe8ad26ecccee03fb05b.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_440b3f640b510d57f88399decbf4fc16.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_dff72cb759cb0b48caf85b7d5a003c2e.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_95845963bbc1c9601536e1ebc29cf88b.jpg not downloaded yet
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_3d313fcb6c96eb9324301544c149d55d.jpg not downloaded yet
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_7ffbeb3ec38df830c1fabf4974a70f14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_3d313fcb6c96eb9324301544c149d55d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_95845963bbc1c9601536e1ebc29cf88b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f64150>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_7ffbeb3ec38df830c1fabf4974a70f14.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_dff72cb759cb0b48caf85b7d5a003c2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60350>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_3d313fcb6c96eb9324301544c149d55d.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c0290>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_95845963bbc1c9601536e1ebc29cf88b.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3090>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_dff72cb759cb0b48caf85b7d5a003c2e.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_440b3f640b510d57f88399decbf4fc16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8e9fd5ab363dbe8ad26ecccee03fb05b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_ec923ea0bd84497157bb140b23262828.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8810>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_440b3f640b510d57f88399decbf4fc16.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_d811a78e5a10e9e4cb9fb266708f2db5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1550>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8e9fd5ab363dbe8ad26ecccee03fb05b.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8dfef0d538a26148165d6e9994ad3768.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e9590>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_ec923ea0bd84497157bb140b23262828.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd84d0>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_d811a78e5a10e9e4cb9fb266708f2db5.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_09351d663ecf672d69f0d21c6f715655.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e7d0>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8dfef0d538a26148165d6e9994ad3768.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_da4f1f945b2e86523c0ffec4b946a14f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c09f90>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_09351d663ecf672d69f0d21c6f715655.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_4e5c9fdce49e8d53bca0475774d671cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f66010>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_da4f1f945b2e86523c0ffec4b946a14f.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfd4d367-55fa-520f-ac5a-74219e842e77
2026-04-27 08:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfd4d367-55fa-520f-ac5a-74219e842e77, skipping ID generation
2026-04-27 08:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 1
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfd4d367-55fa-520f-ac5a-74219e842e77 sending to next pipeline
2026-04-27 08:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfd4d367-55fa-520f-ac5a-74219e842e77, identifier: TP67168
2026-04-27 08:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-04-27 08:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-04-27 08:07:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168 to the API
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_da4f1f945b2e86523c0ffec4b946a14f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'city': 'Seddiner See',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:46:49Z',
 'fuel_type': 'diesel',
 'id': 'bfd4d367-55fa-520f-ac5a-74219e842e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP67168',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 290646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_da4f1f945b2e86523c0ffec4b946a14f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_09351d663ecf672d69f0d21c6f715655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8dfef0d538a26148165d6e9994ad3768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_d811a78e5a10e9e4cb9fb266708f2db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_ec923ea0bd84497157bb140b23262828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_8e9fd5ab363dbe8ad26ecccee03fb05b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_440b3f640b510d57f88399decbf4fc16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_dff72cb759cb0b48caf85b7d5a003c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_95845963bbc1c9601536e1ebc29cf88b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfd4d367-55fa-520f-ac5a-74219e842e77/bfd4d367-55fa-520f-ac5a-74219e842e77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2c/962ccfdc22b988a2efeb685a4da67925/pa/TP67168_3d313fcb6c96eb9324301544c149d55d.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2012-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2012}
2026-04-27 08:07:26 [auto1.de] INFO: Saving data for TP67168: {'created_time': 1777277246.857203, 'last_price_update_time': 1777277246.857212, 'has_photos': True, 'auction_closing_time': 1777391209.0}
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_ece1fcc0259a7d5d133eef614bb35885.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1e490>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_4e5c9fdce49e8d53bca0475774d671cc.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d62150>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_ece1fcc0259a7d5d133eef614bb35885.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_1cb5efca059ddc0f50dc739bf468c9d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_3bc4d2a482ddd99fe001a89fc36b8aa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3017e9d0>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_1cb5efca059ddc0f50dc739bf468c9d0.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed1450>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_3bc4d2a482ddd99fe001a89fc36b8aa9.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32
2026-04-27 08:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb955a74-6765-5954-b7a9-bbe6e8bd0d32, skipping ID generation
2026-04-27 08:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with scrape type 1
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb955a74-6765-5954-b7a9-bbe6e8bd0d32 sending to next pipeline
2026-04-27 08:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb955a74-6765-5954-b7a9-bbe6e8bd0d32, identifier: PU83477
2026-04-27 08:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with identifier: PU83477
2026-04-27 08:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with identifier: PU83477
2026-04-27 08:07:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb955a74-6765-5954-b7a9-bbe6e8bd0d32 with identifier: PU83477 to the API
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_3bc4d2a482ddd99fe001a89fc36b8aa9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Schkopau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:29:36Z',
 'fuel_type': 'petrol',
 'id': 'eb955a74-6765-5954-b7a9-bbe6e8bd0d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU83477',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 175592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_3bc4d2a482ddd99fe001a89fc36b8aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_1cb5efca059ddc0f50dc739bf468c9d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_ece1fcc0259a7d5d133eef614bb35885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_4e5c9fdce49e8d53bca0475774d671cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_eb955a74-6765-5954-b7a9-bbe6e8bd0d32/eb955a74-6765-5954-b7a9-bbe6e8bd0d32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/b1/46b17b8e18c64ebec3771af2b51bf396/pa/PU83477_7ffbeb3ec38df830c1fabf4974a70f14.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2010-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-04-27 08:07:27 [auto1.de] INFO: Saving data for PU83477: {'created_time': 1777277247.658159, 'last_price_update_time': 1777277247.658168, 'has_photos': True, 'auction_closing_time': 1777390176.0}
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED13433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC11343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY70267> (referer: https://www.auto1.com/v1/car-details-view/LY70267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47694292-d2b5-5131-b2af-5e58dedf696d with identifier: LY70267
2026-04-27 08:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47694292-d2b5-5131-b2af-5e58dedf696d with scrape type 1
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_405ff84bbd887c22cfac0600c91e185e.jpg not downloaded yet
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_6181762b0a16f7a854c79fc6e80ba263.jpg not downloaded yet
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0d92fc33024cf66ab32a44bc6647903a.jpg not downloaded yet
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0226a3d34578653dd50ae5da3bc9146e.jpg not downloaded yet
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_751fa9ed6b58d800dab46bd0937989dd.jpg not downloaded yet
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL85430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_751fa9ed6b58d800dab46bd0937989dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e90f50>
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_751fa9ed6b58d800dab46bd0937989dd.jpg saved to cache
2026-04-27 08:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC79074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0226a3d34578653dd50ae5da3bc9146e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e90e10>
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0226a3d34578653dd50ae5da3bc9146e.jpg saved to cache
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0d92fc33024cf66ab32a44bc6647903a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028bad0>
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0d92fc33024cf66ab32a44bc6647903a.jpg saved to cache
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:31 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 10642 | hits on page: 40
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: PE12481
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: SY15259
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: EM10383
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: SS01241
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: ZE36706
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: LY70267
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: PU83477
2026-04-27 08:07:31 [auto1.de] INFO: Scrape type for PU83477: 0
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: XY85636
2026-04-27 08:07:31 [auto1.de] INFO: Scrape type for XY85636: 0
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: VM97001
2026-04-27 08:07:31 [auto1.de] INFO: Scrape type for VM97001: 0
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: WK54006
2026-04-27 08:07:31 [auto1.de] INFO: Scrape type for WK54006: 0
2026-04-27 08:07:31 [auto1.de] INFO: Found listing with ID: BE46966
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for BE46966: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: LD63966
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for LD63966: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: LX06150
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for LX06150: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: TP67168
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for TP67168: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: EM35795
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for EM35795: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: AK26500
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: XL56937
2026-04-27 08:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_6181762b0a16f7a854c79fc6e80ba263.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: CP48685
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for CP48685: 0
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: FL62048
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for FL62048: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: XG32148
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for XG32148: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: DG46200
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for DG46200: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: GH70383
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for GH70383: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: NL59666
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for NL59666: 1
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd5290>
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_6181762b0a16f7a854c79fc6e80ba263.jpg saved to cache
2026-04-27 08:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: AH46995
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for AH46995: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: KP40220
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for KP40220: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: KS92375
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for KS92375: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: EV94490
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for EV94490: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: CM30450
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for CM30450: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: WB51072
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for WB51072: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: BV45977
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for BV45977: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: GW17934
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for GW17934: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: PB92040
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for PB92040: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: ZN73895
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for ZN73895: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: RU20217
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for RU20217: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: ZT02890
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for ZT02890: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: FG36016
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for FG36016: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: PM92730
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for PM92730: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: MJ79028
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for MJ79028: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: MH32022
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for MH32022: 1
2026-04-27 08:07:32 [auto1.de] INFO: Found listing with ID: FN32397
2026-04-27 08:07:32 [auto1.de] INFO: Scrape type for FN32397: 1
2026-04-27 08:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX68221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL56937> (referer: https://www.auto1.com/v1/car-details-view/XL56937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-04-27 08:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 1
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d9fcc916dda26ea2af45d8e652c0b14a.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_6a5fcdbea261bf972c99b04a0defdb81.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d0fe762d28a56c4bb3bf93f63bd339af.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_ce81c94a0bf46217e5c7249e16423960.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_13be16c0f75a5f3fd60ab153442ed47d.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_33bcea7e85cf6d809039d92baa253e8f.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_e5603ad4d8d43d9b1be6ba4254256d8d.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_9c1800cc9056f29a54f4f4aefba4cfe6.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_08e2c026b9540d86c574e2a04a5ca86e.jpg not downloaded yet
2026-04-27 08:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_1a395ec52c97db3f92ae883f8915930c.jpg not downloaded yet
2026-04-27 08:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE12481> (referer: https://www.auto1.com/v1/car-details-view/PE12481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3210aae-425c-5e3c-b0aa-eed701a55b28 with identifier: PE12481
2026-04-27 08:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3210aae-425c-5e3c-b0aa-eed701a55b28 with scrape type 1
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_3d9200991d681f036a17a33bc4c9de74.jpg not downloaded yet
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_83cc88d6b11d588b4a788080b89ea1df.jpg not downloaded yet
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_d318ce36d461dbff46ad821183ab6aef.jpg not downloaded yet
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ed0f51331f9e84b9f65f56f0fea3210b.jpg not downloaded yet
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ecbc6be13197717651c6c7f15c1a28c4.jpg not downloaded yet
2026-04-27 08:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_1a395ec52c97db3f92ae883f8915930c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b9990>
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_1a395ec52c97db3f92ae883f8915930c.jpg saved to cache
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ecbc6be13197717651c6c7f15c1a28c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ed0f51331f9e84b9f65f56f0fea3210b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026ec10>
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ecbc6be13197717651c6c7f15c1a28c4.jpg saved to cache
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b06b90>
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ed0f51331f9e84b9f65f56f0fea3210b.jpg saved to cache
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM10383> (referer: https://www.auto1.com/v1/car-details-view/EM10383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59a9bde7-7094-5322-9719-1f8a25960ea4 with identifier: EM10383
2026-04-27 08:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a9bde7-7094-5322-9719-1f8a25960ea4 with scrape type 1
2026-04-27 08:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20e11e80e41aa99e9743795508b1b4c4.jpg not downloaded yet
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_d318ce36d461dbff46ad821183ab6aef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_f0ee8254c897320b31df6b3ad887e889.jpg not downloaded yet
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20d051d9c2c086cd4685dbfb33871d65.jpg not downloaded yet
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_2a5bb05bf22e6cb7c1b1fbc6c36efdb4.jpg not downloaded yet
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_d1277f2b8ccac1b22538fb30571fe7d1.jpg not downloaded yet
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20e11e80e41aa99e9743795508b1b4c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e695d0>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_d318ce36d461dbff46ad821183ab6aef.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_d1277f2b8ccac1b22538fb30571fe7d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_83cc88d6b11d588b4a788080b89ea1df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a343d0>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20e11e80e41aa99e9743795508b1b4c4.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_2a5bb05bf22e6cb7c1b1fbc6c36efdb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006c6d0>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_d1277f2b8ccac1b22538fb30571fe7d1.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_f0ee8254c897320b31df6b3ad887e889.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006e110>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_83cc88d6b11d588b4a788080b89ea1df.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20d051d9c2c086cd4685dbfb33871d65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a342d0>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_2a5bb05bf22e6cb7c1b1fbc6c36efdb4.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_3d9200991d681f036a17a33bc4c9de74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302881d0>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_f0ee8254c897320b31df6b3ad887e889.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300afe50>
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20d051d9c2c086cd4685dbfb33871d65.jpg saved to cache
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59a9bde7-7094-5322-9719-1f8a25960ea4
2026-04-27 08:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59a9bde7-7094-5322-9719-1f8a25960ea4, skipping ID generation
2026-04-27 08:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a9bde7-7094-5322-9719-1f8a25960ea4 with scrape type 1
2026-04-27 08:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59a9bde7-7094-5322-9719-1f8a25960ea4 sending to next pipeline
2026-04-27 08:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59a9bde7-7094-5322-9719-1f8a25960ea4, identifier: EM10383
2026-04-27 08:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59a9bde7-7094-5322-9719-1f8a25960ea4 with identifier: EM10383
2026-04-27 08:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59a9bde7-7094-5322-9719-1f8a25960ea4 with identifier: EM10383
2026-04-27 08:07:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59a9bde7-7094-5322-9719-1f8a25960ea4 with identifier: EM10383 to the API
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20d051d9c2c086cd4685dbfb33871d65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 256,
 'category': None,
 'city': 'Hattingen',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:25:19Z',
 'fuel_type': 'petrol',
 'id': '59a9bde7-7094-5322-9719-1f8a25960ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM10383',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 163341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20e11e80e41aa99e9743795508b1b4c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_f0ee8254c897320b31df6b3ad887e889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_20d051d9c2c086cd4685dbfb33871d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_2a5bb05bf22e6cb7c1b1fbc6c36efdb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_59a9bde7-7094-5322-9719-1f8a25960ea4/59a9bde7-7094-5322-9719-1f8a25960ea4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/12/8612ef4c79f2fd064f01eaf0491157ee/pa/EM10383_d1277f2b8ccac1b22538fb30571fe7d1.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2001-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 240 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2001}
2026-04-27 08:07:38 [auto1.de] INFO: Saving data for EM10383: {'created_time': 1777277258.123323, 'last_price_update_time': 1777277258.123333, 'has_photos': True, 'auction_closing_time': 1777389919.0}
2026-04-27 08:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_08e2c026b9540d86c574e2a04a5ca86e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_9c1800cc9056f29a54f4f4aefba4cfe6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d63a90>
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_3d9200991d681f036a17a33bc4c9de74.jpg saved to cache
2026-04-27 08:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3210aae-425c-5e3c-b0aa-eed701a55b28
2026-04-27 08:07:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3210aae-425c-5e3c-b0aa-eed701a55b28, skipping ID generation
2026-04-27 08:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3210aae-425c-5e3c-b0aa-eed701a55b28 with scrape type 1
2026-04-27 08:07:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3210aae-425c-5e3c-b0aa-eed701a55b28 sending to next pipeline
2026-04-27 08:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3210aae-425c-5e3c-b0aa-eed701a55b28, identifier: PE12481
2026-04-27 08:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3210aae-425c-5e3c-b0aa-eed701a55b28 with identifier: PE12481
2026-04-27 08:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3210aae-425c-5e3c-b0aa-eed701a55b28 with identifier: PE12481
2026-04-27 08:07:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3210aae-425c-5e3c-b0aa-eed701a55b28 with identifier: PE12481 to the API
2026-04-27 08:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_3d9200991d681f036a17a33bc4c9de74.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:31:27Z',
 'fuel_type': 'petrol',
 'id': 'd3210aae-425c-5e3c-b0aa-eed701a55b28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE12481',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 151869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_3d9200991d681f036a17a33bc4c9de74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_83cc88d6b11d588b4a788080b89ea1df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_d318ce36d461dbff46ad821183ab6aef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ed0f51331f9e84b9f65f56f0fea3210b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3210aae-425c-5e3c-b0aa-eed701a55b28/d3210aae-425c-5e3c-b0aa-eed701a55b28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/bf/84bffedb2f4be2bb83038d9066829124/pa/PE12481_ecbc6be13197717651c6c7f15c1a28c4.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2007-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2007}
2026-04-27 08:07:39 [auto1.de] INFO: Saving data for PE12481: {'created_time': 1777277259.145352, 'last_price_update_time': 1777277259.145364, 'has_photos': True, 'auction_closing_time': 1777390287.0}
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS13662> (referer: https://www.auto1.com/v1/car-details-view/BS13662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c08bd0>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_08e2c026b9540d86c574e2a04a5ca86e.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4b290>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_9c1800cc9056f29a54f4f4aefba4cfe6.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d875057-90df-5dac-88d2-8ff36f7f0e34 with identifier: BS13662
2026-04-27 08:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d875057-90df-5dac-88d2-8ff36f7f0e34 with scrape type 1
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_47d68e4643ac48c58232c0ee0acfa468.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_c0834c88861b2a07c4e6e6f8d1557675.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_58d14cbf51d1f30f753f5970550682d6.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_887a5989a52da920711b919aa28f83a8.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_67a9d0a87e588a7642965215bc355bec.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_01849e7e69a631743c741baaf5977a22.jpg not downloaded yet
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_33bcea7e85cf6d809039d92baa253e8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_22f69e88bef01a42a63dc84eafc56fc0.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_76a55205c32120ddfd52704e51072577.jpg not downloaded yet
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_e5603ad4d8d43d9b1be6ba4254256d8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_74492373bf28bef62ffa081ba10ff8da.jpg not downloaded yet
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_2db7b57578ebe7675ef5839d7c5f5692.jpg not downloaded yet
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_01849e7e69a631743c741baaf5977a22.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14950>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_33bcea7e85cf6d809039d92baa253e8f.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_2db7b57578ebe7675ef5839d7c5f5692.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f3e710>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_e5603ad4d8d43d9b1be6ba4254256d8d.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_74492373bf28bef62ffa081ba10ff8da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_76a55205c32120ddfd52704e51072577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37410>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_01849e7e69a631743c741baaf5977a22.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_13be16c0f75a5f3fd60ab153442ed47d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30167050>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_2db7b57578ebe7675ef5839d7c5f5692.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e16bd0>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_74492373bf28bef62ffa081ba10ff8da.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e77310>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_76a55205c32120ddfd52704e51072577.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_67a9d0a87e588a7642965215bc355bec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015b250>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_13be16c0f75a5f3fd60ab153442ed47d.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_887a5989a52da920711b919aa28f83a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_22f69e88bef01a42a63dc84eafc56fc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_47d68e4643ac48c58232c0ee0acfa468.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006fb50>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_67a9d0a87e588a7642965215bc355bec.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30288110>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_887a5989a52da920711b919aa28f83a8.jpg saved to cache
2026-04-27 08:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da32d0>
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_22f69e88bef01a42a63dc84eafc56fc0.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b1e310>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_47d68e4643ac48c58232c0ee0acfa468.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_58d14cbf51d1f30f753f5970550682d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_c0834c88861b2a07c4e6e6f8d1557675.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_ce81c94a0bf46217e5c7249e16423960.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d9fcc916dda26ea2af45d8e652c0b14a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003f7d0>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_58d14cbf51d1f30f753f5970550682d6.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026e450>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_c0834c88861b2a07c4e6e6f8d1557675.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d875057-90df-5dac-88d2-8ff36f7f0e34
2026-04-27 08:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d875057-90df-5dac-88d2-8ff36f7f0e34, skipping ID generation
2026-04-27 08:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d875057-90df-5dac-88d2-8ff36f7f0e34 with scrape type 1
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d875057-90df-5dac-88d2-8ff36f7f0e34 sending to next pipeline
2026-04-27 08:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d875057-90df-5dac-88d2-8ff36f7f0e34, identifier: BS13662
2026-04-27 08:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d875057-90df-5dac-88d2-8ff36f7f0e34 with identifier: BS13662
2026-04-27 08:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d875057-90df-5dac-88d2-8ff36f7f0e34 with identifier: BS13662
2026-04-27 08:07:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d875057-90df-5dac-88d2-8ff36f7f0e34 with identifier: BS13662 to the API
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_c0834c88861b2a07c4e6e6f8d1557675.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:20:19Z',
 'fuel_type': 'diesel',
 'id': '8d875057-90df-5dac-88d2-8ff36f7f0e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS13662',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 308953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_47d68e4643ac48c58232c0ee0acfa468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_c0834c88861b2a07c4e6e6f8d1557675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_58d14cbf51d1f30f753f5970550682d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_887a5989a52da920711b919aa28f83a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_67a9d0a87e588a7642965215bc355bec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_01849e7e69a631743c741baaf5977a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_22f69e88bef01a42a63dc84eafc56fc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_76a55205c32120ddfd52704e51072577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_74492373bf28bef62ffa081ba10ff8da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8d875057-90df-5dac-88d2-8ff36f7f0e34/8d875057-90df-5dac-88d2-8ff36f7f0e34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/10/0a10e92da2ec1e504f5fcb2c5c9240b7/pa/BS13662_2db7b57578ebe7675ef5839d7c5f5692.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2007-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-04-27 08:07:40 [auto1.de] INFO: Saving data for BS13662: {'created_time': 1777277260.74773, 'last_price_update_time': 1777277260.747741, 'has_photos': True, 'auction_closing_time': 1777389619.0}
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d0fe762d28a56c4bb3bf93f63bd339af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_6a5fcdbea261bf972c99b04a0defdb81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG08115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF31968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291ea90>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_ce81c94a0bf46217e5c7249e16423960.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e6a9d0>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d9fcc916dda26ea2af45d8e652c0b14a.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1110>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d0fe762d28a56c4bb3bf93f63bd339af.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32098b50>
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_6a5fcdbea261bf972c99b04a0defdb81.jpg saved to cache
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edc9cb10-babd-5e17-97f1-7965df10c168
2026-04-27 08:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edc9cb10-babd-5e17-97f1-7965df10c168, skipping ID generation
2026-04-27 08:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 1
2026-04-27 08:07:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edc9cb10-babd-5e17-97f1-7965df10c168 sending to next pipeline
2026-04-27 08:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc9cb10-babd-5e17-97f1-7965df10c168, identifier: XL56937
2026-04-27 08:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-04-27 08:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-04-27 08:07:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937 to the API
2026-04-27 08:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_6a5fcdbea261bf972c99b04a0defdb81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Germersheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 205,
 'expiration_date': '2026-04-28T15:35:29Z',
 'fuel_type': 'petrol',
 'id': 'edc9cb10-babd-5e17-97f1-7965df10c168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL56937',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 59367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d9fcc916dda26ea2af45d8e652c0b14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_6a5fcdbea261bf972c99b04a0defdb81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_d0fe762d28a56c4bb3bf93f63bd339af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_ce81c94a0bf46217e5c7249e16423960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_13be16c0f75a5f3fd60ab153442ed47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_33bcea7e85cf6d809039d92baa253e8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_e5603ad4d8d43d9b1be6ba4254256d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_9c1800cc9056f29a54f4f4aefba4cfe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_08e2c026b9540d86c574e2a04a5ca86e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_edc9cb10-babd-5e17-97f1-7965df10c168/edc9cb10-babd-5e17-97f1-7965df10c168_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/f5/e4f588e2c1a53a877a7a9f431b44ad05/pa/XL56937_1a395ec52c97db3f92ae883f8915930c.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2023-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-04-27 08:07:42 [auto1.de] INFO: Saving data for XL56937: {'created_time': 1777277262.15105, 'last_price_update_time': 1777277262.151063, 'has_photos': True, 'auction_closing_time': 1777390529.0}
2026-04-27 08:07:43 [scrapy.extensions.logstats] INFO: Crawled 577 pages (at 17 pages/min), scraped 255 items (at 6 items/min)
2026-04-27 08:07:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC79074> (referer: https://www.auto1.com/v1/car-details-view/EC79074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-04-27 08:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 1
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg not downloaded yet
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK26500> (referer: https://www.auto1.com/v1/car-details-view/AK26500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-04-27 08:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee2a469-befa-5607-b315-aebe1f19de9f with scrape type 1
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg not downloaded yet
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg not downloaded yet
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg not downloaded yet
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d4eb50>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d310>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 10646 | hits on page: 40
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: PM92730
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: MJ79028
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: MH32022
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: FN32397
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: HV13956
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for HV13956: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: NF13899
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for NF13899: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: DU56840
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for DU56840: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: MH24339
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for MH24339: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: FM37440
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for FM37440: 1
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302889d0>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7be50>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: CX40237
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for CX40237: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: VK88134
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for VK88134: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: TX12342
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for TX12342: 1
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0a310>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: PK76037
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for PK76037: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: LS72141
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for LS72141: 1
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0110>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: LZ21667
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for LZ21667: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: XK59952
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for XK59952: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: JY20186
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for JY20186: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: CY77324
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for CY77324: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: BV23650
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for BV23650: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: XR64222
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for XR64222: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: MM98410
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for MM98410: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: HF53882
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for HF53882: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: XF94363
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for XF94363: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: UT28734
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for UT28734: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: GH81329
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for GH81329: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: NJ21212
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for NJ21212: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: PA49455
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for PA49455: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: CN91045
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for CN91045: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: YN89321
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for YN89321: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: YH32821
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for YH32821: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: FT05667
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for FT05667: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: GJ97454
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for GJ97454: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: PG96754
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for PG96754: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: HR12459
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for HR12459: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: AN09987
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for AN09987: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: YS84502
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for YS84502: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: DV03966
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for DV03966: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: SH94739
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for SH94739: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: KP66478
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for KP66478: 1
2026-04-27 08:07:51 [auto1.de] INFO: Found listing with ID: UP81002
2026-04-27 08:07:51 [auto1.de] INFO: Scrape type for UP81002: 1
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX68221> (referer: https://www.auto1.com/v1/car-details-view/VX68221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with identifier: VX68221
2026-04-27 08:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with scrape type 1
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_b7b0f7f877f7fe01ea9ecc1dc797e323.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3bccc5e65cc1f870148cc8f7374455f3.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_07752c8a98c79e598ea5726b9139da93.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_ce0ea56c464f4af125d3e3f623fe0ebd.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3b57dd578489e2974cfe62b77c86c537.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_dc0acd16f7b18024fdc178db2a16185c.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_7014ef0ae8fd542ae6e9fe7d80adcea3.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_cef10a3256f9652d18905d2a4438c22e.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_614a33b3e7f6f3579cd56135660acbca.jpg not downloaded yet
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_9f13702d125983d2a5d3bc8c2ee343c4.jpg not downloaded yet
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN32397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_9f13702d125983d2a5d3bc8c2ee343c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a58410>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_9f13702d125983d2a5d3bc8c2ee343c4.jpg saved to cache
2026-04-27 08:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ79028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_614a33b3e7f6f3579cd56135660acbca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cefed0>
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_614a33b3e7f6f3579cd56135660acbca.jpg saved to cache
2026-04-27 08:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM92730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_cef10a3256f9652d18905d2a4438c22e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300acbd0>
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_cef10a3256f9652d18905d2a4438c22e.jpg saved to cache
2026-04-27 08:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG36016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_7014ef0ae8fd542ae6e9fe7d80adcea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceedd0>
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_7014ef0ae8fd542ae6e9fe7d80adcea3.jpg saved to cache
2026-04-27 08:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH32022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_dc0acd16f7b18024fdc178db2a16185c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5f10>
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_dc0acd16f7b18024fdc178db2a16185c.jpg saved to cache
2026-04-27 08:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT02890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3b57dd578489e2974cfe62b77c86c537.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efa490>
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3b57dd578489e2974cfe62b77c86c537.jpg saved to cache
2026-04-27 08:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH24339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_ce0ea56c464f4af125d3e3f623fe0ebd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY15259> (referer: https://www.auto1.com/v1/car-details-view/SY15259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a59110>
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_ce0ea56c464f4af125d3e3f623fe0ebd.jpg saved to cache
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f46638-84d2-53d0-b544-f08e2f291ac0 with identifier: SY15259
2026-04-27 08:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f46638-84d2-53d0-b544-f08e2f291ac0 with scrape type 1
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_b5eb288dd8d9babef106c42be9798152.jpg not downloaded yet
2026-04-27 08:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_07752c8a98c79e598ea5726b9139da93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_6aac53f7e91a7b74e590d0f347fa872c.jpg not downloaded yet
2026-04-27 08:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_f7ccabd0d718ac008c02199bf4cbfdac.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e8726641b8cfb25e47f648cd87994f1d.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e28ad717d57e867f3de74ee1a9a21a89.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_1c79e06356fae0e2f744307b3ea7ae58.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_23cf0f5ad53be68924c605e31ee62862.jpg not downloaded yet
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_b5eb288dd8d9babef106c42be9798152.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_dcf5305110c9d99ca08c50156c44bca1.jpg not downloaded yet
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9fa10>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_07752c8a98c79e598ea5726b9139da93.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_30fcf0f48f4da997e0af4a0bd8964764.jpg not downloaded yet
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_a3b2c0dc2058d4177019c118c993f838.jpg not downloaded yet
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7b710>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_b5eb288dd8d9babef106c42be9798152.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_23cf0f5ad53be68924c605e31ee62862.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e94d0>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_23cf0f5ad53be68924c605e31ee62862.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_a3b2c0dc2058d4177019c118c993f838.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015ab10>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_a3b2c0dc2058d4177019c118c993f838.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_30fcf0f48f4da997e0af4a0bd8964764.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66290>
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_30fcf0f48f4da997e0af4a0bd8964764.jpg saved to cache
2026-04-27 08:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_dcf5305110c9d99ca08c50156c44bca1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9e50>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_dcf5305110c9d99ca08c50156c44bca1.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_1c79e06356fae0e2f744307b3ea7ae58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efb210>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_1c79e06356fae0e2f744307b3ea7ae58.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e28ad717d57e867f3de74ee1a9a21a89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da0490>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e28ad717d57e867f3de74ee1a9a21a89.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e8726641b8cfb25e47f648cd87994f1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d9d0>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e8726641b8cfb25e47f648cd87994f1d.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_f7ccabd0d718ac008c02199bf4cbfdac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF31968> (referer: https://www.auto1.com/v1/car-details-view/LF31968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e310>
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_f7ccabd0d718ac008c02199bf4cbfdac.jpg saved to cache
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e736e0f-24f4-5a20-973d-165604109416 with identifier: LF31968
2026-04-27 08:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e736e0f-24f4-5a20-973d-165604109416 with scrape type 1
2026-04-27 08:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_24df97abbc63ad65b8ea29eec88b52e3.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_dd7f9ebab69765035b379111b732737e.jpg not downloaded yet
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_6aac53f7e91a7b74e590d0f347fa872c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_b796c15a049a33cb1488b1b2491ac1e3.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_1f53bca792dca3dcfd2248e40f639392.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_16742daec25ae5c468f9e08144a7edeb.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_437c417f9f7b0268ff2d8730933a5f67.jpg not downloaded yet
2026-04-27 08:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3bccc5e65cc1f870148cc8f7374455f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_9afea8e185b74c41ab858b5890cdfc3f.jpg not downloaded yet
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5a310>
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_6aac53f7e91a7b74e590d0f347fa872c.jpg saved to cache
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87f46638-84d2-53d0-b544-f08e2f291ac0
2026-04-27 08:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87f46638-84d2-53d0-b544-f08e2f291ac0, skipping ID generation
2026-04-27 08:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f46638-84d2-53d0-b544-f08e2f291ac0 with scrape type 1
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87f46638-84d2-53d0-b544-f08e2f291ac0 sending to next pipeline
2026-04-27 08:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87f46638-84d2-53d0-b544-f08e2f291ac0, identifier: SY15259
2026-04-27 08:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_5faea1bb46f45c0ede7978136480b296.jpg not downloaded yet
2026-04-27 08:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87f46638-84d2-53d0-b544-f08e2f291ac0 with identifier: SY15259
2026-04-27 08:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87f46638-84d2-53d0-b544-f08e2f291ac0 with identifier: SY15259
2026-04-27 08:08:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87f46638-84d2-53d0-b544-f08e2f291ac0 with identifier: SY15259 to the API
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_6aac53f7e91a7b74e590d0f347fa872c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:02:40Z',
 'fuel_type': 'petrol',
 'id': '87f46638-84d2-53d0-b544-f08e2f291ac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY15259',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 131964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_b5eb288dd8d9babef106c42be9798152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_6aac53f7e91a7b74e590d0f347fa872c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_f7ccabd0d718ac008c02199bf4cbfdac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e8726641b8cfb25e47f648cd87994f1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_e28ad717d57e867f3de74ee1a9a21a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_1c79e06356fae0e2f744307b3ea7ae58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_23cf0f5ad53be68924c605e31ee62862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_dcf5305110c9d99ca08c50156c44bca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_30fcf0f48f4da997e0af4a0bd8964764.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87f46638-84d2-53d0-b544-f08e2f291ac0/87f46638-84d2-53d0-b544-f08e2f291ac0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/dc/53dc69a965f7833a78789fed7f4c06c2/pa/SY15259_a3b2c0dc2058d4177019c118c993f838.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2014-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Pulsar 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-04-27 08:08:08 [auto1.de] INFO: Saving data for SY15259: {'created_time': 1777277288.994568, 'last_price_update_time': 1777277288.994581, 'has_photos': True, 'auction_closing_time': 1777388560.0}
2026-04-27 08:08:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.712(s), this was the 1st time calling it.
2026-04-27 08:08:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3286135324040975 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_dd7f9ebab69765035b379111b732737e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_ebf016ca61b22b605fb0b8e70f53ae52.jpg not downloaded yet
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ac450>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3bccc5e65cc1f870148cc8f7374455f3.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_d727c3dafbcf28f0876aad4d5ca30c84.jpg not downloaded yet
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a9d0>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_dd7f9ebab69765035b379111b732737e.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_437c417f9f7b0268ff2d8730933a5f67.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5a10>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_437c417f9f7b0268ff2d8730933a5f67.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_5faea1bb46f45c0ede7978136480b296.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_d727c3dafbcf28f0876aad4d5ca30c84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f34650>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_5faea1bb46f45c0ede7978136480b296.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291d910>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_d727c3dafbcf28f0876aad4d5ca30c84.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_ebf016ca61b22b605fb0b8e70f53ae52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_9afea8e185b74c41ab858b5890cdfc3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9f810>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_ebf016ca61b22b605fb0b8e70f53ae52.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f68b50>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_9afea8e185b74c41ab858b5890cdfc3f.jpg saved to cache
2026-04-27 08:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_1f53bca792dca3dcfd2248e40f639392.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_16742daec25ae5c468f9e08144a7edeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_24df97abbc63ad65b8ea29eec88b52e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_b7b0f7f877f7fe01ea9ecc1dc797e323.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM37440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5250>
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_1f53bca792dca3dcfd2248e40f639392.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15010>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_16742daec25ae5c468f9e08144a7edeb.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b03b10>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_24df97abbc63ad65b8ea29eec88b52e3.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dca7d0>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_b7b0f7f877f7fe01ea9ecc1dc797e323.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70
2026-04-27 08:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bea10d39-e9c9-51cb-b79b-cf5dc1089f70, skipping ID generation
2026-04-27 08:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with scrape type 1
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bea10d39-e9c9-51cb-b79b-cf5dc1089f70 sending to next pipeline
2026-04-27 08:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea10d39-e9c9-51cb-b79b-cf5dc1089f70, identifier: VX68221
2026-04-27 08:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with identifier: VX68221
2026-04-27 08:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with identifier: VX68221
2026-04-27 08:08:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea10d39-e9c9-51cb-b79b-cf5dc1089f70 with identifier: VX68221 to the API
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_b7b0f7f877f7fe01ea9ecc1dc797e323.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:20:41Z',
 'fuel_type': 'diesel',
 'id': 'bea10d39-e9c9-51cb-b79b-cf5dc1089f70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX68221',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 127365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_b7b0f7f877f7fe01ea9ecc1dc797e323.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3bccc5e65cc1f870148cc8f7374455f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_07752c8a98c79e598ea5726b9139da93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_ce0ea56c464f4af125d3e3f623fe0ebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_3b57dd578489e2974cfe62b77c86c537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_dc0acd16f7b18024fdc178db2a16185c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_7014ef0ae8fd542ae6e9fe7d80adcea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_cef10a3256f9652d18905d2a4438c22e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_614a33b3e7f6f3579cd56135660acbca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bea10d39-e9c9-51cb-b79b-cf5dc1089f70/bea10d39-e9c9-51cb-b79b-cf5dc1089f70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda0f7fb94d42ba281210f3b09cb418/pa/VX68221_9f13702d125983d2a5d3bc8c2ee343c4.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2013-02-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-04-27 08:08:10 [auto1.de] INFO: Saving data for VX68221: {'created_time': 1777277290.695738, 'last_price_update_time': 1777277290.69575, 'has_photos': True, 'auction_closing_time': 1777389641.0}
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_b796c15a049a33cb1488b1b2491ac1e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.337(s), this was the 1st time calling it.
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.225317338066408 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC11343> (referer: https://www.auto1.com/v1/car-details-view/ZC11343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6a090>
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_b796c15a049a33cb1488b1b2491ac1e3.jpg saved to cache
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e736e0f-24f4-5a20-973d-165604109416
2026-04-27 08:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e736e0f-24f4-5a20-973d-165604109416, skipping ID generation
2026-04-27 08:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e736e0f-24f4-5a20-973d-165604109416 with scrape type 1
2026-04-27 08:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e736e0f-24f4-5a20-973d-165604109416 sending to next pipeline
2026-04-27 08:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e736e0f-24f4-5a20-973d-165604109416, identifier: LF31968
2026-04-27 08:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e736e0f-24f4-5a20-973d-165604109416 with identifier: LF31968
2026-04-27 08:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e736e0f-24f4-5a20-973d-165604109416 with identifier: LF31968
2026-04-27 08:08:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e736e0f-24f4-5a20-973d-165604109416 with identifier: LF31968 to the API
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_b796c15a049a33cb1488b1b2491ac1e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-04-28T15:43:19Z',
 'fuel_type': 'diesel',
 'id': '8e736e0f-24f4-5a20-973d-165604109416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF31968',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 161813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_24df97abbc63ad65b8ea29eec88b52e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_dd7f9ebab69765035b379111b732737e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_b796c15a049a33cb1488b1b2491ac1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_1f53bca792dca3dcfd2248e40f639392.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_16742daec25ae5c468f9e08144a7edeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_437c417f9f7b0268ff2d8730933a5f67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_9afea8e185b74c41ab858b5890cdfc3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_5faea1bb46f45c0ede7978136480b296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_ebf016ca61b22b605fb0b8e70f53ae52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e736e0f-24f4-5a20-973d-165604109416/8e736e0f-24f4-5a20-973d-165604109416_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c7/61c7e3c4a9dca1452ffa91776872eb47/pa/LF31968_d727c3dafbcf28f0876aad4d5ca30c84.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-04-27 08:08:11 [auto1.de] INFO: Saving data for LF31968: {'created_time': 1777277291.278398, 'last_price_update_time': 1777277291.27841, 'has_photos': True, 'auction_closing_time': 1777390999.0}
2026-04-27 08:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010f81f6-2682-5339-8371-0c5e11824ff6 with identifier: ZC11343
2026-04-27 08:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010f81f6-2682-5339-8371-0c5e11824ff6 with scrape type 1
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_69217e205aa7d352ae5f9e3d5baf73ca.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_41d5e0885b1d62919f65a011fc52cbdb.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_92f48f0e79079befef0207f90b60cb89.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5402de423a42115079ab85f0aeb91dd4.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_a5741a2eae6f7f684378cde3049ca7ec.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_87ba66e7b6d6086651fe47b7642cca0f.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5b8697c37095d068f735775d90667a82.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_3ab5d9502b54c53c4ca34935cc261cd1.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_609605ec2b7dbb7d1c9fd303ccdfec20.jpg not downloaded yet
2026-04-27 08:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_d98df5b58f820a7a8d7685d6dd487025.jpg not downloaded yet
2026-04-27 08:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.563(s), this was the 1st time calling it.
2026-04-27 08:08:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.345518474081736 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ79028> (referer: https://www.auto1.com/v1/car-details-view/MJ79028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b63377-6cd6-52dd-8b82-05492480f3c1 with identifier: MJ79028
2026-04-27 08:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b63377-6cd6-52dd-8b82-05492480f3c1 with scrape type 1
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_876a6c70fc13d4ffc0661094e3b1ea3e.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_9f4b288866c1deaeda5cc0fe3d6ecc6b.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_34a27703392958334c8498b7b0ace1ef.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_640620a708c867bcf4e5237b89d41534.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_57bbbefa81cc20af3b63fa5456645146.jpg not downloaded yet
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_d98df5b58f820a7a8d7685d6dd487025.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_118450fec53faa2ab4c9428203724097.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_a3d669056726bb79b2a1839e4d6e515f.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_62419b0241db8e03920496987ee472c5.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_6e22f62f2c5afeb02dd8ba3edad4669b.jpg not downloaded yet
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_672b6ac113ea24f84b85fff642799429.jpg not downloaded yet
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d69350>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_d98df5b58f820a7a8d7685d6dd487025.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_57bbbefa81cc20af3b63fa5456645146.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_672b6ac113ea24f84b85fff642799429.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eac1d0>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_57bbbefa81cc20af3b63fa5456645146.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d9c10>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_672b6ac113ea24f84b85fff642799429.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_6e22f62f2c5afeb02dd8ba3edad4669b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ead110>
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_6e22f62f2c5afeb02dd8ba3edad4669b.jpg saved to cache
2026-04-27 08:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_62419b0241db8e03920496987ee472c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_a3d669056726bb79b2a1839e4d6e515f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed1b90>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_62419b0241db8e03920496987ee472c5.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dc91d0>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_a3d669056726bb79b2a1839e4d6e515f.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_118450fec53faa2ab4c9428203724097.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37ad0>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_118450fec53faa2ab4c9428203724097.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_640620a708c867bcf4e5237b89d41534.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE36706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e09390>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_640620a708c867bcf4e5237b89d41534.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_9f4b288866c1deaeda5cc0fe3d6ecc6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_34a27703392958334c8498b7b0ace1ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_876a6c70fc13d4ffc0661094e3b1ea3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d2291ce10>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_9f4b288866c1deaeda5cc0fe3d6ecc6b.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb8f90>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_34a27703392958334c8498b7b0ace1ef.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eeaa10>
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_876a6c70fc13d4ffc0661094e3b1ea3e.jpg saved to cache
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0b63377-6cd6-52dd-8b82-05492480f3c1
2026-04-27 08:08:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0b63377-6cd6-52dd-8b82-05492480f3c1, skipping ID generation
2026-04-27 08:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b63377-6cd6-52dd-8b82-05492480f3c1 with scrape type 1
2026-04-27 08:08:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0b63377-6cd6-52dd-8b82-05492480f3c1 sending to next pipeline
2026-04-27 08:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0b63377-6cd6-52dd-8b82-05492480f3c1, identifier: MJ79028
2026-04-27 08:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0b63377-6cd6-52dd-8b82-05492480f3c1 with identifier: MJ79028
2026-04-27 08:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0b63377-6cd6-52dd-8b82-05492480f3c1 with identifier: MJ79028
2026-04-27 08:08:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0b63377-6cd6-52dd-8b82-05492480f3c1 with identifier: MJ79028 to the API
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_876a6c70fc13d4ffc0661094e3b1ea3e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'city': 'Seddiner See',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:43:38Z',
 'fuel_type': 'diesel',
 'id': 'e0b63377-6cd6-52dd-8b82-05492480f3c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ79028',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 231564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_876a6c70fc13d4ffc0661094e3b1ea3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_9f4b288866c1deaeda5cc0fe3d6ecc6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_34a27703392958334c8498b7b0ace1ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_640620a708c867bcf4e5237b89d41534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_57bbbefa81cc20af3b63fa5456645146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_118450fec53faa2ab4c9428203724097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_a3d669056726bb79b2a1839e4d6e515f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_62419b0241db8e03920496987ee472c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_6e22f62f2c5afeb02dd8ba3edad4669b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e0b63377-6cd6-52dd-8b82-05492480f3c1/e0b63377-6cd6-52dd-8b82-05492480f3c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/8c/f68c7b07895badf4dd92d253c74d5666/pa/MJ79028_672b6ac113ea24f84b85fff642799429.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-04-27 08:08:17 [auto1.de] INFO: Saving data for MJ79028: {'created_time': 1777277297.438488, 'last_price_update_time': 1777277297.438499, 'has_photos': True, 'auction_closing_time': 1777391018.0}
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_609605ec2b7dbb7d1c9fd303ccdfec20.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS01241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM92730> (referer: https://www.auto1.com/v1/car-details-view/PM92730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH32022> (referer: https://www.auto1.com/v1/car-details-view/MH32022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_3ab5d9502b54c53c4ca34935cc261cd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ce190>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_609605ec2b7dbb7d1c9fd303ccdfec20.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5402de423a42115079ab85f0aeb91dd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5b8697c37095d068f735775d90667a82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with identifier: PM92730
2026-04-27 08:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with scrape type 1
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_2289c27f1c8cbb9d6740f0df177f420e.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with identifier: MH32022
2026-04-27 08:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with scrape type 1
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_f27638fe39481cb936be6c0aacdd25c1.jpg not downloaded yet
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_87ba66e7b6d6086651fe47b7642cca0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_04ea19873accf4970679708e20eced47.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_be83f3b13b848f89b464f650982bb271.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_8a128b88a3822f7f045ed31f9c7d80fd.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_d2c61081f72518a67aabd9a368435c4b.jpg not downloaded yet
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32098990>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_3ab5d9502b54c53c4ca34935cc261cd1.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0650>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5402de423a42115079ab85f0aeb91dd4.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196a50>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5b8697c37095d068f735775d90667a82.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_92f48f0e79079befef0207f90b60cb89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_b7cb211c5d529bd419eca478efd99f16.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_ef1ea03c62a74cdab68392743ad30a3b.jpg not downloaded yet
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_69217e205aa7d352ae5f9e3d5baf73ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_a5741a2eae6f7f684378cde3049ca7ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_41d5e0885b1d62919f65a011fc52cbdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3a5321eec4674f3e4df4577b14a59d50.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_aab301ec18f559b0b421c6b9e7f30e9a.jpg not downloaded yet
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d4c488f10>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_87ba66e7b6d6086651fe47b7642cca0f.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_94167912a3ff80d4e8aabc7ab1a391ce.jpg not downloaded yet
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP81002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_7a99914a062504be0b87d8b949f26a71.jpg not downloaded yet
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1fb10>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_92f48f0e79079befef0207f90b60cb89.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_6a5de1463b878ecc32e3104cbfb71645.jpg not downloaded yet
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3270bfa1106e0b50192f4946bf9eba11.jpg not downloaded yet
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30051950>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_69217e205aa7d352ae5f9e3d5baf73ca.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014c290>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_a5741a2eae6f7f684378cde3049ca7ec.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4ee90>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_41d5e0885b1d62919f65a011fc52cbdb.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 010f81f6-2682-5339-8371-0c5e11824ff6
2026-04-27 08:08:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 010f81f6-2682-5339-8371-0c5e11824ff6, skipping ID generation
2026-04-27 08:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010f81f6-2682-5339-8371-0c5e11824ff6 with scrape type 1
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 010f81f6-2682-5339-8371-0c5e11824ff6 sending to next pipeline
2026-04-27 08:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 010f81f6-2682-5339-8371-0c5e11824ff6, identifier: ZC11343
2026-04-27 08:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 010f81f6-2682-5339-8371-0c5e11824ff6 with identifier: ZC11343
2026-04-27 08:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 010f81f6-2682-5339-8371-0c5e11824ff6 with identifier: ZC11343
2026-04-27 08:08:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 010f81f6-2682-5339-8371-0c5e11824ff6 with identifier: ZC11343 to the API
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_41d5e0885b1d62919f65a011fc52cbdb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'city': 'Schkopau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:10:40Z',
 'fuel_type': 'petrol',
 'id': '010f81f6-2682-5339-8371-0c5e11824ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC11343',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'BMW',
 'model': '1er',
 'odometer': 103332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_69217e205aa7d352ae5f9e3d5baf73ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_41d5e0885b1d62919f65a011fc52cbdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_92f48f0e79079befef0207f90b60cb89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5402de423a42115079ab85f0aeb91dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_a5741a2eae6f7f684378cde3049ca7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_87ba66e7b6d6086651fe47b7642cca0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_5b8697c37095d068f735775d90667a82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_3ab5d9502b54c53c4ca34935cc261cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_609605ec2b7dbb7d1c9fd303ccdfec20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_010f81f6-2682-5339-8371-0c5e11824ff6/010f81f6-2682-5339-8371-0c5e11824ff6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/aa/edaab98b70a1b67dc2fe670aea914c36/pa/ZC11343_d98df5b58f820a7a8d7685d6dd487025.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2017-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 120i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-04-27 08:08:19 [auto1.de] INFO: Saving data for ZC11343: {'created_time': 1777277299.265422, 'last_price_update_time': 1777277299.265432, 'has_photos': True, 'auction_closing_time': 1777389040.0}
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_d2c61081f72518a67aabd9a368435c4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_164b0ec4c0713b687bd8bea3c06cbf5b.jpg not downloaded yet
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_04ea19873accf4970679708e20eced47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_be83f3b13b848f89b464f650982bb271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_8a128b88a3822f7f045ed31f9c7d80fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT02890> (referer: https://www.auto1.com/v1/car-details-view/ZT02890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH24339> (referer: https://www.auto1.com/v1/car-details-view/MH24339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3270bfa1106e0b50192f4946bf9eba11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a650>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_d2c61081f72518a67aabd9a368435c4b.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3016cad0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_04ea19873accf4970679708e20eced47.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0a190>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_be83f3b13b848f89b464f650982bb271.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f35150>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_8a128b88a3822f7f045ed31f9c7d80fd.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with identifier: ZT02890
2026-04-27 08:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with scrape type 1
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_f3dae581e2e072c8119e1adeedacb1d0.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-04-27 08:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 1
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_4b2f011e99f4c2310f41fe3ae2b8aa30.jpg not downloaded yet
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_94167912a3ff80d4e8aabc7ab1a391ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_aab301ec18f559b0b421c6b9e7f30e9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_9029b45002a2b34814d4f9cd3211f96b.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_262b6a58235461c0b6552eb3e0c02976.jpg not downloaded yet
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_164b0ec4c0713b687bd8bea3c06cbf5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3a5321eec4674f3e4df4577b14a59d50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_7a99914a062504be0b87d8b949f26a71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_6a5de1463b878ecc32e3104cbfb71645.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_56d4d61fde50bd7f62ec4c9494dd3f9e.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_caf7023d82063803009b4dc73abc732f.jpg not downloaded yet
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82490>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3270bfa1106e0b50192f4946bf9eba11.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d97576ea8456fe38da3b4557818ec816.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_918a172531efa9ac0abe382c78d67446.jpg not downloaded yet
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_4b2f011e99f4c2310f41fe3ae2b8aa30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_f3dae581e2e072c8119e1adeedacb1d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d741645c173e10bee76233d25305607f.jpg not downloaded yet
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_2e3bf7e57d3cd66f138e32d68dea3183.jpg not downloaded yet
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d910>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_94167912a3ff80d4e8aabc7ab1a391ce.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc24d0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_aab301ec18f559b0b421c6b9e7f30e9a.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_b7cb211c5d529bd419eca478efd99f16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_2289c27f1c8cbb9d6740f0df177f420e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_f27638fe39481cb936be6c0aacdd25c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_6ea5a329daa891270d83a87e820a0c76.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a54950>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_164b0ec4c0713b687bd8bea3c06cbf5b.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30059d10>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3a5321eec4674f3e4df4577b14a59d50.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d522d0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_7a99914a062504be0b87d8b949f26a71.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b42e50>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_6a5de1463b878ecc32e3104cbfb71645.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_ef1ea03c62a74cdab68392743ad30a3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_b636d5bbc47925b40642414222a3e6b1.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c3890>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_4b2f011e99f4c2310f41fe3ae2b8aa30.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2a710>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_f3dae581e2e072c8119e1adeedacb1d0.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_56d4d61fde50bd7f62ec4c9494dd3f9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_caf7023d82063803009b4dc73abc732f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL85430> (referer: https://www.auto1.com/v1/car-details-view/SL85430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb19d0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_b7cb211c5d529bd419eca478efd99f16.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcd110>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_2289c27f1c8cbb9d6740f0df177f420e.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f
2026-04-27 08:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f, skipping ID generation
2026-04-27 08:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with scrape type 1
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f sending to next pipeline
2026-04-27 08:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f, identifier: PM92730
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f536d0>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_f27638fe39481cb936be6c0aacdd25c1.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_918a172531efa9ac0abe382c78d67446.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_def91de4d7312e2e300fa9acf0995025.jpg not downloaded yet
2026-04-27 08:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with identifier: PM92730
2026-04-27 08:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with identifier: PM92730
2026-04-27 08:08:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f with identifier: PM92730 to the API
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_2289c27f1c8cbb9d6740f0df177f420e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'city': 'Erbach',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:33:03Z',
 'fuel_type': 'petrol',
 'id': 'e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM92730',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 56481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_2289c27f1c8cbb9d6740f0df177f420e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_04ea19873accf4970679708e20eced47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_8a128b88a3822f7f045ed31f9c7d80fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_b7cb211c5d529bd419eca478efd99f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3a5321eec4674f3e4df4577b14a59d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_94167912a3ff80d4e8aabc7ab1a391ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_7a99914a062504be0b87d8b949f26a71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_6a5de1463b878ecc32e3104cbfb71645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_3270bfa1106e0b50192f4946bf9eba11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f/e6882f6c-1cb5-5e4d-bb82-b47b7e0cf06f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/30/4a30d31fba3de2bdbfa2a3f1ef798689/pa/PM92730_164b0ec4c0713b687bd8bea3c06cbf5b.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2016-10-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-04-27 08:08:21 [auto1.de] INFO: Saving data for PM92730: {'created_time': 1777277301.08217, 'last_price_update_time': 1777277301.08218, 'has_photos': True, 'auction_closing_time': 1777390383.0}
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d97576ea8456fe38da3b4557818ec816.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d741645c173e10bee76233d25305607f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP66478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2d390>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_ef1ea03c62a74cdab68392743ad30a3b.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94, skipping ID generation
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 sending to next pipeline
2026-04-27 08:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94, identifier: MH32022
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_2e3bf7e57d3cd66f138e32d68dea3183.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_371bf894a0a632e41670287fb8655e0a.jpg not downloaded yet
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN32397> (referer: https://www.auto1.com/v1/car-details-view/FN32397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG36016> (referer: https://www.auto1.com/v1/car-details-view/FG36016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with identifier: MH32022
2026-04-27 08:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with identifier: MH32022
2026-04-27 08:08:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647d13ee-6ff6-53be-be45-ea7fc2ce9e94 with identifier: MH32022 to the API
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_ef1ea03c62a74cdab68392743ad30a3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:28:06Z',
 'fuel_type': 'petrol',
 'id': '647d13ee-6ff6-53be-be45-ea7fc2ce9e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH32022',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 234253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_f27638fe39481cb936be6c0aacdd25c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_be83f3b13b848f89b464f650982bb271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_d2c61081f72518a67aabd9a368435c4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_ef1ea03c62a74cdab68392743ad30a3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_647d13ee-6ff6-53be-be45-ea7fc2ce9e94/647d13ee-6ff6-53be-be45-ea7fc2ce9e94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/57/00578297014f25ffd44f5c67ded0dca8/pa/MH32022_aab301ec18f559b0b421c6b9e7f30e9a.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2009-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-04-27 08:08:21 [auto1.de] INFO: Saving data for MH32022: {'created_time': 1777277301.636777, 'last_price_update_time': 1777277301.636787, 'has_photos': True, 'auction_closing_time': 1777390086.0}
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6e190>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_56d4d61fde50bd7f62ec4c9494dd3f9e.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0f90>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_caf7023d82063803009b4dc73abc732f.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_d76a91a4988293749da79541e22db749.jpg not downloaded yet
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed1050>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_918a172531efa9ac0abe382c78d67446.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_262b6a58235461c0b6552eb3e0c02976.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_ea52c96fcebfbb205761fea119fc4628.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_722cb9a0160710de637e1802f9296608.jpg not downloaded yet
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_6ea5a329daa891270d83a87e820a0c76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_b636d5bbc47925b40642414222a3e6b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_9029b45002a2b34814d4f9cd3211f96b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca09d0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d97576ea8456fe38da3b4557818ec816.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d634d0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d741645c173e10bee76233d25305607f.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efb650>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_2e3bf7e57d3cd66f138e32d68dea3183.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3558785-85b3-546b-aa97-81950630a726 with identifier: FN32397
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3558785-85b3-546b-aa97-81950630a726 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_6170c630531c18ddffd256c970cd032c.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849de7d2-9206-570c-8abb-6bb1294d47c4 with identifier: FG36016
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849de7d2-9206-570c-8abb-6bb1294d47c4 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d0ef1de337e3d90de758665397d966d0.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_2dcedec46a326549ab1528009c5a8efa.jpg not downloaded yet
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_def91de4d7312e2e300fa9acf0995025.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c968800788464c49c74427ba6c1938b6.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_71def2999b8b47ea9ad7cf7d0928b436.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e7041af1f34efe593ef7d8c4ef5efe48.jpg not downloaded yet
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30283d10>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_262b6a58235461c0b6552eb3e0c02976.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2b5d0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_6ea5a329daa891270d83a87e820a0c76.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e68350>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_b636d5bbc47925b40642414222a3e6b1.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2bfd0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_9029b45002a2b34814d4f9cd3211f96b.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3
2026-04-27 08:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3, skipping ID generation
2026-04-27 08:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with scrape type 1
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 sending to next pipeline
2026-04-27 08:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3, identifier: ZT02890
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_facfd5d30f5f77d8911295fece8894f3.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d7da2912da59ca9f38f97ee1cb71cef3.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with identifier: ZT02890
2026-04-27 08:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with identifier: ZT02890
2026-04-27 08:08:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acfed052-b4ab-5d1c-8d93-c5ff69a2efc3 with identifier: ZT02890 to the API
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_9029b45002a2b34814d4f9cd3211f96b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'city': 'Zülpich',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:37:35Z',
 'fuel_type': 'petrol',
 'id': 'acfed052-b4ab-5d1c-8d93-c5ff69a2efc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT02890',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 162096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_f3dae581e2e072c8119e1adeedacb1d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_9029b45002a2b34814d4f9cd3211f96b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_56d4d61fde50bd7f62ec4c9494dd3f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d97576ea8456fe38da3b4557818ec816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acfed052-b4ab-5d1c-8d93-c5ff69a2efc3/acfed052-b4ab-5d1c-8d93-c5ff69a2efc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/b4/39b41e5aa6b116c1da67aef03d68c098/pa/ZT02890_d741645c173e10bee76233d25305607f.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2011-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2011}
2026-04-27 08:08:22 [auto1.de] INFO: Saving data for ZT02890: {'created_time': 1777277302.918475, 'last_price_update_time': 1777277302.918485, 'has_photos': True, 'auction_closing_time': 1777390655.0}
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_d76a91a4988293749da79541e22db749.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_371bf894a0a632e41670287fb8655e0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_c6941acab93fca3325b0ab4d7d21f1e3.jpg not downloaded yet
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_b9268c39b71f1a2995342bb8b06d1f23.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_6368a078bd60ba468afdaf89eca29a11.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV03966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d8950>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_def91de4d7312e2e300fa9acf0995025.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e14453798215f0ad3aa1be2d3fed1a8f.jpg not downloaded yet
2026-04-27 08:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM37440> (referer: https://www.auto1.com/v1/car-details-view/FM37440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_04f82f9dc44ba8ad18b218a2457f716a.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_691bbc0d06b3e4bd15d8f9a29bfbf4fc.jpg not downloaded yet
2026-04-27 08:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e4d8b41e1b74de2019300ebc61f438c6.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_87d45c2dfb15a53303ed42e665daa321.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_50d66708f7988f4dd682ecada41710d8.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_2dcedec46a326549ab1528009c5a8efa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e6b8bb41ccf90d3582a5aadcb0ea1796.jpg not downloaded yet
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d090>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_d76a91a4988293749da79541e22db749.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a80f50>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_371bf894a0a632e41670287fb8655e0a.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e7041af1f34efe593ef7d8c4ef5efe48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_b9268c39b71f1a2995342bb8b06d1f23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_6368a078bd60ba468afdaf89eca29a11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_dda01b927c21926542d12f6bb7d56292.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_e0b908f106d9b4073cdbff27264b43a4.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_71def2999b8b47ea9ad7cf7d0928b436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_573deb9d2b02a5ccf57e4add8cdfa93d.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d6cae1-4a66-57e7-a892-1973e3ea5384 with identifier: FM37440
2026-04-27 08:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d6cae1-4a66-57e7-a892-1973e3ea5384 with scrape type 1
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_4b1fa0b1ed5caea8986614f6a4acc192.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_a0250961d68c119f4ae11977097a4223.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0575fe5813432e563743bbfd6b424f16.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_3c1207a1c3a7cb1f2df595bfdaee54c8.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_12cba9b94f0b4d49af92de706d3e2af6.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e4d8b41e1b74de2019300ebc61f438c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c49c216f1ef10bec3331b3e6342589ac.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_f0a393fd9e20f10d891e316ac1704563.jpg not downloaded yet
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f34d0>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_2dcedec46a326549ab1528009c5a8efa.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_87d45c2dfb15a53303ed42e665daa321.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_e8b617169a1f9fbdb67b05679bfcd3a3.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_691bbc0d06b3e4bd15d8f9a29bfbf4fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_9f90aa3a8d62d4fe90ada0bb2a6b5a5f.jpg not downloaded yet
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0e1e26a2858695ce2ad69d1a20febeeb.jpg not downloaded yet
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee64d0>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e7041af1f34efe593ef7d8c4ef5efe48.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4450>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_b9268c39b71f1a2995342bb8b06d1f23.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cafa90>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_6368a078bd60ba468afdaf89eca29a11.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9ce50>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_71def2999b8b47ea9ad7cf7d0928b436.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_f693faae1810237e73ee93b705790842.jpg not downloaded yet
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_50d66708f7988f4dd682ecada41710d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0575fe5813432e563743bbfd6b424f16.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_ce0a7a612aa313a7c3b27ad179f21a9e.jpg not downloaded yet
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1de10>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e4d8b41e1b74de2019300ebc61f438c6.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab2750>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_87d45c2dfb15a53303ed42e665daa321.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2b0d0>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_691bbc0d06b3e4bd15d8f9a29bfbf4fc.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_f0a393fd9e20f10d891e316ac1704563.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22feb810>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_50d66708f7988f4dd682ecada41710d8.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d81490>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0575fe5813432e563743bbfd6b424f16.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_12cba9b94f0b4d49af92de706d3e2af6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077350>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_f0a393fd9e20f10d891e316ac1704563.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0e1e26a2858695ce2ad69d1a20febeeb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_9f90aa3a8d62d4fe90ada0bb2a6b5a5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f4b9710>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_12cba9b94f0b4d49af92de706d3e2af6.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_e8b617169a1f9fbdb67b05679bfcd3a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_f693faae1810237e73ee93b705790842.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30188610>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0e1e26a2858695ce2ad69d1a20febeeb.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_a0250961d68c119f4ae11977097a4223.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_ce0a7a612aa313a7c3b27ad179f21a9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d93010>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_9f90aa3a8d62d4fe90ada0bb2a6b5a5f.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c49c216f1ef10bec3331b3e6342589ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ece390>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_e8b617169a1f9fbdb67b05679bfcd3a3.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b59d10>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_f693faae1810237e73ee93b705790842.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_3c1207a1c3a7cb1f2df595bfdaee54c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_4b1fa0b1ed5caea8986614f6a4acc192.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_573deb9d2b02a5ccf57e4add8cdfa93d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca0250>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_a0250961d68c119f4ae11977097a4223.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9ed0>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_ce0a7a612aa313a7c3b27ad179f21a9e.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb10d0>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c49c216f1ef10bec3331b3e6342589ac.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_e0b908f106d9b4073cdbff27264b43a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e6b8bb41ccf90d3582a5aadcb0ea1796.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7af110>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_3c1207a1c3a7cb1f2df595bfdaee54c8.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2f250>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_4b1fa0b1ed5caea8986614f6a4acc192.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d6cae1-4a66-57e7-a892-1973e3ea5384
2026-04-27 08:08:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d6cae1-4a66-57e7-a892-1973e3ea5384, skipping ID generation
2026-04-27 08:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d6cae1-4a66-57e7-a892-1973e3ea5384 with scrape type 1
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d6cae1-4a66-57e7-a892-1973e3ea5384 sending to next pipeline
2026-04-27 08:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6d6cae1-4a66-57e7-a892-1973e3ea5384, identifier: FM37440
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b79dd0>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_573deb9d2b02a5ccf57e4add8cdfa93d.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6d6cae1-4a66-57e7-a892-1973e3ea5384 with identifier: FM37440
2026-04-27 08:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6d6cae1-4a66-57e7-a892-1973e3ea5384 with identifier: FM37440
2026-04-27 08:08:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6d6cae1-4a66-57e7-a892-1973e3ea5384 with identifier: FM37440 to the API
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_4b1fa0b1ed5caea8986614f6a4acc192.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Fockbek',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:00:40Z',
 'fuel_type': 'petrol',
 'id': 'd6d6cae1-4a66-57e7-a892-1973e3ea5384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM37440',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 139675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_4b1fa0b1ed5caea8986614f6a4acc192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_12cba9b94f0b4d49af92de706d3e2af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_e8b617169a1f9fbdb67b05679bfcd3a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_f693faae1810237e73ee93b705790842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6d6cae1-4a66-57e7-a892-1973e3ea5384/d6d6cae1-4a66-57e7-a892-1973e3ea5384_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/5707e352fdb0f7c4b971f946a6caffea/pa/FM37440_ce0a7a612aa313a7c3b27ad179f21a9e.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2009-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-04-27 08:08:25 [auto1.de] INFO: Saving data for FM37440: {'created_time': 1777277305.511639, 'last_price_update_time': 1777277305.511649, 'has_photos': True, 'auction_closing_time': 1777388440.0}
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_dda01b927c21926542d12f6bb7d56292.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_04f82f9dc44ba8ad18b218a2457f716a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_c6941acab93fca3325b0ab4d7d21f1e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e14453798215f0ad3aa1be2d3fed1a8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE36706> (referer: https://www.auto1.com/v1/car-details-view/ZE36706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN09987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe9110>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_e0b908f106d9b4073cdbff27264b43a4.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9b50>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e6b8bb41ccf90d3582a5aadcb0ea1796.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_facfd5d30f5f77d8911295fece8894f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75f90>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_dda01b927c21926542d12f6bb7d56292.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b856d0>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_04f82f9dc44ba8ad18b218a2457f716a.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4ff10>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_c6941acab93fca3325b0ab4d7d21f1e3.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43210>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e14453798215f0ad3aa1be2d3fed1a8f.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-04-27 08:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855449ff-f862-5943-bb66-e13e78152f49 with scrape type 1
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg not downloaded yet
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d0ef1de337e3d90de758665397d966d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_722cb9a0160710de637e1802f9296608.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_6170c630531c18ddffd256c970cd032c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg not downloaded yet
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d7da2912da59ca9f38f97ee1cb71cef3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c968800788464c49c74427ba6c1938b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8d2d0>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_facfd5d30f5f77d8911295fece8894f3.jpg saved to cache
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg not downloaded yet
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg not downloaded yet
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg not downloaded yet
2026-04-27 08:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg not downloaded yet
2026-04-27 08:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8db90>
2026-04-27 08:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d0ef1de337e3d90de758665397d966d0.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d909d0>
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_722cb9a0160710de637e1802f9296608.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83, skipping ID generation
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with scrape type 1
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 sending to next pipeline
2026-04-27 08:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83, identifier: SL85430
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9d690>
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_6170c630531c18ddffd256c970cd032c.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg not downloaded yet
2026-04-27 08:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-04-27 08:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-04-27 08:08:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430 to the API
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_722cb9a0160710de637e1802f9296608.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'city': 'Helvesiek',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:36:45Z',
 'fuel_type': 'diesel',
 'id': '7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 53.2161,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL85430',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'location_confidence': 'geocoded',
 'longitude': 9.4915,
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 112954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_d76a91a4988293749da79541e22db749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_722cb9a0160710de637e1802f9296608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_2dcedec46a326549ab1528009c5a8efa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e7041af1f34efe593ef7d8c4ef5efe48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_c6941acab93fca3325b0ab4d7d21f1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e14453798215f0ad3aa1be2d3fed1a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e4d8b41e1b74de2019300ebc61f438c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_e6b8bb41ccf90d3582a5aadcb0ea1796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_573deb9d2b02a5ccf57e4add8cdfa93d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83/7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/01/b701dc98fd8b03544c07c58bf256679b/pa/SL85430_3c1207a1c3a7cb1f2df595bfdaee54c8.jpg',
             'Width': 800}],
 'postal_code': '27389',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2021-08-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 mittellang Hochdach FWD',
 'year': 2021}
2026-04-27 08:08:26 [auto1.de] INFO: Saving data for SL85430: {'created_time': 1777277306.666698, 'last_price_update_time': 1777277306.66671, 'has_photos': True, 'auction_closing_time': 1777390605.0}
2026-04-27 08:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_ea52c96fcebfbb205761fea119fc4628.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg not downloaded yet
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1890>
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d7da2912da59ca9f38f97ee1cb71cef3.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 849de7d2-9206-570c-8abb-6bb1294d47c4
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 849de7d2-9206-570c-8abb-6bb1294d47c4, skipping ID generation
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849de7d2-9206-570c-8abb-6bb1294d47c4 with scrape type 1
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 849de7d2-9206-570c-8abb-6bb1294d47c4 sending to next pipeline
2026-04-27 08:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 849de7d2-9206-570c-8abb-6bb1294d47c4, identifier: FG36016
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1b10>
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c968800788464c49c74427ba6c1938b6.jpg saved to cache
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3558785-85b3-546b-aa97-81950630a726
2026-04-27 08:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3558785-85b3-546b-aa97-81950630a726, skipping ID generation
2026-04-27 08:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3558785-85b3-546b-aa97-81950630a726 with scrape type 1
2026-04-27 08:08:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3558785-85b3-546b-aa97-81950630a726 sending to next pipeline
2026-04-27 08:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3558785-85b3-546b-aa97-81950630a726, identifier: FN32397
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300780d0>
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg saved to cache
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 849de7d2-9206-570c-8abb-6bb1294d47c4 with identifier: FG36016
2026-04-27 08:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 849de7d2-9206-570c-8abb-6bb1294d47c4 with identifier: FG36016
2026-04-27 08:08:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 849de7d2-9206-570c-8abb-6bb1294d47c4 with identifier: FG36016 to the API
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d7da2912da59ca9f38f97ee1cb71cef3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Dortmund',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:29:44Z',
 'fuel_type': 'diesel',
 'id': '849de7d2-9206-570c-8abb-6bb1294d47c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG36016',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 171484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d0ef1de337e3d90de758665397d966d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_71def2999b8b47ea9ad7cf7d0928b436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_d7da2912da59ca9f38f97ee1cb71cef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_6368a078bd60ba468afdaf89eca29a11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_691bbc0d06b3e4bd15d8f9a29bfbf4fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_50d66708f7988f4dd682ecada41710d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_e0b908f106d9b4073cdbff27264b43a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0575fe5813432e563743bbfd6b424f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_f0a393fd9e20f10d891e316ac1704563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_849de7d2-9206-570c-8abb-6bb1294d47c4/849de7d2-9206-570c-8abb-6bb1294d47c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/6a/d56a46de9b424ae99bc5f0148843880f/pa/FG36016_0e1e26a2858695ce2ad69d1a20febeeb.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2012-04-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Tech',
 'year': 2012}
2026-04-27 08:08:27 [auto1.de] INFO: Saving data for FG36016: {'created_time': 1777277307.345186, 'last_price_update_time': 1777277307.345195, 'has_photos': True, 'auction_closing_time': 1777390184.0}
2026-04-27 08:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3558785-85b3-546b-aa97-81950630a726 with identifier: FN32397
2026-04-27 08:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3558785-85b3-546b-aa97-81950630a726 with identifier: FN32397
2026-04-27 08:08:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3558785-85b3-546b-aa97-81950630a726 with identifier: FN32397 to the API
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c968800788464c49c74427ba6c1938b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'city': 'Überherrn',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 224,
 'expiration_date': '2026-04-28T15:24:26Z',
 'fuel_type': 'petrol',
 'id': 'a3558785-85b3-546b-aa97-81950630a726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN32397',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 66103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_6170c630531c18ddffd256c970cd032c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c968800788464c49c74427ba6c1938b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_facfd5d30f5f77d8911295fece8894f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_b9268c39b71f1a2995342bb8b06d1f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_04f82f9dc44ba8ad18b218a2457f716a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_87d45c2dfb15a53303ed42e665daa321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_dda01b927c21926542d12f6bb7d56292.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_a0250961d68c119f4ae11977097a4223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_c49c216f1ef10bec3331b3e6342589ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3558785-85b3-546b-aa97-81950630a726/a3558785-85b3-546b-aa97-81950630a726_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/f3/76f32a7596487e64fda2270916397b4b/pa/FN32397_9f90aa3a8d62d4fe90ada0bb2a6b5a5f.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2019-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-04-27 08:08:27 [auto1.de] INFO: Saving data for FN32397: {'created_time': 1777277307.743772, 'last_price_update_time': 1777277307.743783, 'has_photos': True, 'auction_closing_time': 1777389866.0}
2026-04-27 08:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg not downloaded yet
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1e7d0>
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_ea52c96fcebfbb205761fea119fc4628.jpg saved to cache
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acea335d-749a-573e-9503-5e65dd24a15c
2026-04-27 08:08:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acea335d-749a-573e-9503-5e65dd24a15c, skipping ID generation
2026-04-27 08:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 1
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acea335d-749a-573e-9503-5e65dd24a15c sending to next pipeline
2026-04-27 08:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acea335d-749a-573e-9503-5e65dd24a15c, identifier: MH24339
2026-04-27 08:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg not downloaded yet
2026-04-27 08:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-04-27 08:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-04-27 08:08:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339 to the API
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_ea52c96fcebfbb205761fea119fc4628.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Erbach',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2026-04-28T15:57:02Z',
 'fuel_type': 'diesel',
 'id': 'acea335d-749a-573e-9503-5e65dd24a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 48.3284,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH24339',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'location_confidence': 'geocoded',
 'longitude': 9.8875,
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 300246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_4b2f011e99f4c2310f41fe3ae2b8aa30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_262b6a58235461c0b6552eb3e0c02976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_caf7023d82063803009b4dc73abc732f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_918a172531efa9ac0abe382c78d67446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_2e3bf7e57d3cd66f138e32d68dea3183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_6ea5a329daa891270d83a87e820a0c76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_b636d5bbc47925b40642414222a3e6b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_def91de4d7312e2e300fa9acf0995025.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_371bf894a0a632e41670287fb8655e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_acea335d-749a-573e-9503-5e65dd24a15c/acea335d-749a-573e-9503-5e65dd24a15c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/fd/64fdc771bf7aa6fb038c224dc3868247/pa/MH24339_ea52c96fcebfbb205761fea119fc4628.jpg',
             'Width': 800}],
 'postal_code': '89155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Tübingen Region',
 'province_code': 'DE-084',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2015-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-04-27 08:08:28 [auto1.de] INFO: Saving data for MH24339: {'created_time': 1777277308.290536, 'last_price_update_time': 1777277308.290545, 'has_photos': True, 'auction_closing_time': 1777391822.0}
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196610>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75350>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5c50>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5890>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e09610>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba6ed0>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2910>
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg saved to cache
2026-04-27 08:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca06d0>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0add0>
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg saved to cache
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 855449ff-f862-5943-bb66-e13e78152f49
2026-04-27 08:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 855449ff-f862-5943-bb66-e13e78152f49, skipping ID generation
2026-04-27 08:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855449ff-f862-5943-bb66-e13e78152f49 with scrape type 1
2026-04-27 08:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 855449ff-f862-5943-bb66-e13e78152f49 sending to next pipeline
2026-04-27 08:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 855449ff-f862-5943-bb66-e13e78152f49, identifier: ZE36706
2026-04-27 08:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-04-27 08:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-04-27 08:08:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706 to the API
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Dortmund',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:25:31Z',
 'fuel_type': 'petrol',
 'id': '855449ff-f862-5943-bb66-e13e78152f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE36706',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 37724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2018}
2026-04-27 08:08:29 [auto1.de] INFO: Saving data for ZE36706: {'created_time': 1777277309.563101, 'last_price_update_time': 1777277309.563112, 'has_photos': True, 'auction_closing_time': 1777389931.0}
2026-04-27 08:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS01241> (referer: https://www.auto1.com/v1/car-details-view/SS01241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with identifier: SS01241
2026-04-27 08:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with scrape type 1
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_f54546a27573f678c618d1a453b52930.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_cad30d4b6ade33453bdbdeb0d87cdc84.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e9d86ca23fbe970b796a3b00f903e28e.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_59f7a8120b502081870d7e85226c3fc9.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_24df860b2d73098c2684c402f7ed16c8.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_a9dc3296dad162cfdab3889a68cfd2a6.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_5a980eb98c184b24cc0b8729346b1d04.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_254c1e7f7762e064db5a1e19cf6b63a4.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_362e9ea7cec08688d06a5bab5f90cf5c.jpg not downloaded yet
2026-04-27 08:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e72c18b89efd840809109bc9b5e9c912.jpg not downloaded yet
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS84502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e72c18b89efd840809109bc9b5e9c912.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7650>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e72c18b89efd840809109bc9b5e9c912.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU93534> (referer: https://www.auto1.com/v1/car-details-view/XU93534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b1ad66-d215-52b4-9c4f-b95807a20769 with identifier: XU93534
2026-04-27 08:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b1ad66-d215-52b4-9c4f-b95807a20769 with scrape type 1
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_297531b019b9006c24be5e5e013ee214.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_bcdbc1797f20e752738c8bb7026ee726.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_0fe2d37bea0dbb010c913597b7ae89b2.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_49c2e1b9159d83e3c129247019064e0c.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_fd3954d4ce741435854b0bd5bcc30c66.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_2103bf4c32f93986dafe3385872a368a.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_d53aff1d7751517139a804e6897b9f38.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_c5ea33f52d33ad0465f4bf4d3be8d4c9.jpg not downloaded yet
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_362e9ea7cec08688d06a5bab5f90cf5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_dc4ba749c483d14d2a4dc2af79f90395.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_87c8f326114e07ae232822833ca655ee.jpg not downloaded yet
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c2490>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_362e9ea7cec08688d06a5bab5f90cf5c.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_c5ea33f52d33ad0465f4bf4d3be8d4c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3250>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_c5ea33f52d33ad0465f4bf4d3be8d4c9.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_87c8f326114e07ae232822833ca655ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c650>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_87c8f326114e07ae232822833ca655ee.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_dc4ba749c483d14d2a4dc2af79f90395.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1110>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_dc4ba749c483d14d2a4dc2af79f90395.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_d53aff1d7751517139a804e6897b9f38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7550>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_d53aff1d7751517139a804e6897b9f38.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_2103bf4c32f93986dafe3385872a368a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65850>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_2103bf4c32f93986dafe3385872a368a.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_fd3954d4ce741435854b0bd5bcc30c66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1d90>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_fd3954d4ce741435854b0bd5bcc30c66.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_49c2e1b9159d83e3c129247019064e0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da3ad0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_49c2e1b9159d83e3c129247019064e0c.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_0fe2d37bea0dbb010c913597b7ae89b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f12d0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_0fe2d37bea0dbb010c913597b7ae89b2.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_bcdbc1797f20e752738c8bb7026ee726.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_297531b019b9006c24be5e5e013ee214.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f2a90>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_bcdbc1797f20e752738c8bb7026ee726.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0550>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_297531b019b9006c24be5e5e013ee214.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90b1ad66-d215-52b4-9c4f-b95807a20769
2026-04-27 08:08:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90b1ad66-d215-52b4-9c4f-b95807a20769, skipping ID generation
2026-04-27 08:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b1ad66-d215-52b4-9c4f-b95807a20769 with scrape type 1
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90b1ad66-d215-52b4-9c4f-b95807a20769 sending to next pipeline
2026-04-27 08:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90b1ad66-d215-52b4-9c4f-b95807a20769, identifier: XU93534
2026-04-27 08:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90b1ad66-d215-52b4-9c4f-b95807a20769 with identifier: XU93534
2026-04-27 08:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90b1ad66-d215-52b4-9c4f-b95807a20769 with identifier: XU93534
2026-04-27 08:08:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90b1ad66-d215-52b4-9c4f-b95807a20769 with identifier: XU93534 to the API
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_297531b019b9006c24be5e5e013ee214.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'city': 'Kandel',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:34:36Z',
 'fuel_type': 'petrol',
 'id': '90b1ad66-d215-52b4-9c4f-b95807a20769',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU93534',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 2162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_297531b019b9006c24be5e5e013ee214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_bcdbc1797f20e752738c8bb7026ee726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_0fe2d37bea0dbb010c913597b7ae89b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_49c2e1b9159d83e3c129247019064e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_fd3954d4ce741435854b0bd5bcc30c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_2103bf4c32f93986dafe3385872a368a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_d53aff1d7751517139a804e6897b9f38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_c5ea33f52d33ad0465f4bf4d3be8d4c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_dc4ba749c483d14d2a4dc2af79f90395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_90b1ad66-d215-52b4-9c4f-b95807a20769/90b1ad66-d215-52b4-9c4f-b95807a20769_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0f/660fb9323620f2889564bf03c3b2a2bc/pa/XU93534_87c8f326114e07ae232822833ca655ee.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2024-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2024}
2026-04-27 08:08:39 [auto1.de] INFO: Saving data for XU93534: {'created_time': 1777277319.010877, 'last_price_update_time': 1777277319.010886, 'has_photos': True, 'auction_closing_time': 1777390476.0}
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_254c1e7f7762e064db5a1e19cf6b63a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb0310>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_254c1e7f7762e064db5a1e19cf6b63a4.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_5a980eb98c184b24cc0b8729346b1d04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca18d0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_5a980eb98c184b24cc0b8729346b1d04.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_a9dc3296dad162cfdab3889a68cfd2a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5bd90>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_a9dc3296dad162cfdab3889a68cfd2a6.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_24df860b2d73098c2684c402f7ed16c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300af610>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_24df860b2d73098c2684c402f7ed16c8.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_59f7a8120b502081870d7e85226c3fc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65a50>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_59f7a8120b502081870d7e85226c3fc9.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e9d86ca23fbe970b796a3b00f903e28e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67290>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e9d86ca23fbe970b796a3b00f903e28e.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_cad30d4b6ade33453bdbdeb0d87cdc84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_f54546a27573f678c618d1a453b52930.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5f050>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_cad30d4b6ade33453bdbdeb0d87cdc84.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f3510>
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_f54546a27573f678c618d1a453b52930.jpg saved to cache
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428
2026-04-27 08:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b5dcf33-9c63-58a8-b766-6ef535e2d428, skipping ID generation
2026-04-27 08:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with scrape type 1
2026-04-27 08:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b5dcf33-9c63-58a8-b766-6ef535e2d428 sending to next pipeline
2026-04-27 08:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b5dcf33-9c63-58a8-b766-6ef535e2d428, identifier: SS01241
2026-04-27 08:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with identifier: SS01241
2026-04-27 08:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with identifier: SS01241
2026-04-27 08:08:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b5dcf33-9c63-58a8-b766-6ef535e2d428 with identifier: SS01241 to the API
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_f54546a27573f678c618d1a453b52930.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 130,
 'expiration_date': '2026-04-28T15:36:56Z',
 'fuel_type': 'diesel',
 'id': '8b5dcf33-9c63-58a8-b766-6ef535e2d428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS01241',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 73648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_f54546a27573f678c618d1a453b52930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_cad30d4b6ade33453bdbdeb0d87cdc84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e9d86ca23fbe970b796a3b00f903e28e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_59f7a8120b502081870d7e85226c3fc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_24df860b2d73098c2684c402f7ed16c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_a9dc3296dad162cfdab3889a68cfd2a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_5a980eb98c184b24cc0b8729346b1d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_254c1e7f7762e064db5a1e19cf6b63a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_362e9ea7cec08688d06a5bab5f90cf5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8b5dcf33-9c63-58a8-b766-6ef535e2d428/8b5dcf33-9c63-58a8-b766-6ef535e2d428_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/58/d5580267e95451dacd8bbb2983cce792/pa/SS01241_e72c18b89efd840809109bc9b5e9c912.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2014}
2026-04-27 08:08:40 [auto1.de] INFO: Saving data for SS01241: {'created_time': 1777277320.896757, 'last_price_update_time': 1777277320.896769, 'has_photos': True, 'auction_closing_time': 1777390616.0}
2026-04-27 08:08:43 [scrapy.extensions.logstats] INFO: Crawled 611 pages (at 34 pages/min), scraped 271 items (at 16 items/min)
2026-04-27 08:08:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR12459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP66478> (referer: https://www.auto1.com/v1/car-details-view/KP66478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with identifier: KP66478
2026-04-27 08:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with scrape type 1
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_7f8ded3365d70e93591cbd9d19a83be5.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_3ffca50c9aabcdc8fdade8dafebcc863.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_fe7b34e7299590b343d465c13389ab9e.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_bf43c7f45af69579a21c8021940abcc2.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_217e2f2be99408b0df09fb901eac89cb.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_a029cf6ee89fcd3174d96d085e23f14b.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_de575e4381b369c7d3938f9ff7f10ca0.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_ab7422ac291b7db33644bfc8acb68b2f.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_4cd9a18d621810a7620ffe58dc575c1b.jpg not downloaded yet
2026-04-27 08:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_b3faa850207884185f6c5af92283693b.jpg not downloaded yet
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG96754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ97454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_b3faa850207884185f6c5af92283693b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_4cd9a18d621810a7620ffe58dc575c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5cf50>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_b3faa850207884185f6c5af92283693b.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_ab7422ac291b7db33644bfc8acb68b2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1c0d0>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_4cd9a18d621810a7620ffe58dc575c1b.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c1350>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_ab7422ac291b7db33644bfc8acb68b2f.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT05667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_de575e4381b369c7d3938f9ff7f10ca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0b6d0>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_de575e4381b369c7d3938f9ff7f10ca0.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN89321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN91045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_a029cf6ee89fcd3174d96d085e23f14b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_217e2f2be99408b0df09fb901eac89cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44ad0>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_a029cf6ee89fcd3174d96d085e23f14b.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4a50>
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_217e2f2be99408b0df09fb901eac89cb.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS84502> (referer: https://www.auto1.com/v1/car-details-view/YS84502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_bf43c7f45af69579a21c8021940abcc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-04-27 08:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 1
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_602e4c76f2a307524778933d499ea197.jpg not downloaded yet
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_fe7b34e7299590b343d465c13389ab9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_09a7d11f1a98ccbc0546089257240a0f.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_ad843e418a03c459134d0f8bb8f3ecc4.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_b6577950c105a6457598e09848940d52.jpg not downloaded yet
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_695d436f248bf57d63bd1bab436b8fbd.jpg not downloaded yet
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65390>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_bf43c7f45af69579a21c8021940abcc2.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018bed0>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_fe7b34e7299590b343d465c13389ab9e.jpg saved to cache
2026-04-27 08:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_602e4c76f2a307524778933d499ea197.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_695d436f248bf57d63bd1bab436b8fbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9d10>
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_602e4c76f2a307524778933d499ea197.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_b6577950c105a6457598e09848940d52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN09987> (referer: https://www.auto1.com/v1/car-details-view/AN09987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208ab90>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_695d436f248bf57d63bd1bab436b8fbd.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b81c50>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_b6577950c105a6457598e09848940d52.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_ad843e418a03c459134d0f8bb8f3ecc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b73e35a-ca28-5df9-a73a-c0596d187132 with identifier: AN09987
2026-04-27 08:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b73e35a-ca28-5df9-a73a-c0596d187132 with scrape type 1
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b9406543702e1e0e3e78faf359fbd21a.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_322af6257224c04f047c694acb93518e.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_98b0b5c1434e9068a94c6ea615bb4c88.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_6b59ab2444fcefe3da8901e7c0acca75.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_2366ef878fbff2ce75289f80d26057a1.jpg not downloaded yet
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_3ffca50c9aabcdc8fdade8dafebcc863.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_a10497e02745e663cd9d5b0077b90de5.jpg not downloaded yet
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_09a7d11f1a98ccbc0546089257240a0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_daee701510641fdefd75c6e47448ab6d.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e36d6d2d725e82147710793ecf5c16cf.jpg not downloaded yet
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebb010>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_ad843e418a03c459134d0f8bb8f3ecc4.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b70d21a3b5fc2d3d52b00dcb87015c71.jpg not downloaded yet
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d63d90>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_3ffca50c9aabcdc8fdade8dafebcc863.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da0c50>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_09a7d11f1a98ccbc0546089257240a0f.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb997bed-8db8-585d-9ca4-2febcee1f0b0
2026-04-27 08:08:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb997bed-8db8-585d-9ca4-2febcee1f0b0, skipping ID generation
2026-04-27 08:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 1
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 sending to next pipeline
2026-04-27 08:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb997bed-8db8-585d-9ca4-2febcee1f0b0, identifier: YS84502
2026-04-27 08:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_2366ef878fbff2ce75289f80d26057a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e2780c188b9ce1c4710d11af20347489.jpg not downloaded yet
2026-04-27 08:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-04-27 08:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-04-27 08:08:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502 to the API
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_09a7d11f1a98ccbc0546089257240a0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:24:06Z',
 'fuel_type': 'diesel',
 'id': 'cb997bed-8db8-585d-9ca4-2febcee1f0b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS84502',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 369064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_602e4c76f2a307524778933d499ea197.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_09a7d11f1a98ccbc0546089257240a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_ad843e418a03c459134d0f8bb8f3ecc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_b6577950c105a6457598e09848940d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb997bed-8db8-585d-9ca4-2febcee1f0b0/cb997bed-8db8-585d-9ca4-2febcee1f0b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97276315da23c6564fc64575164f47/pa/YS84502_695d436f248bf57d63bd1bab436b8fbd.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2007-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-04-27 08:08:50 [auto1.de] INFO: Saving data for YS84502: {'created_time': 1777277330.30248, 'last_price_update_time': 1777277330.302491, 'has_photos': True, 'auction_closing_time': 1777389846.0}
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_6b59ab2444fcefe3da8901e7c0acca75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT28734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1d090>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_2366ef878fbff2ce75289f80d26057a1.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e36d6d2d725e82147710793ecf5c16cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b7ac90>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_6b59ab2444fcefe3da8901e7c0acca75.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e2780c188b9ce1c4710d11af20347489.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_daee701510641fdefd75c6e47448ab6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc950>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e36d6d2d725e82147710793ecf5c16cf.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_98b0b5c1434e9068a94c6ea615bb4c88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5e9d0>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e2780c188b9ce1c4710d11af20347489.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b70d21a3b5fc2d3d52b00dcb87015c71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1c190>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_daee701510641fdefd75c6e47448ab6d.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_a10497e02745e663cd9d5b0077b90de5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30289b10>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_98b0b5c1434e9068a94c6ea615bb4c88.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5910>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b70d21a3b5fc2d3d52b00dcb87015c71.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b9406543702e1e0e3e78faf359fbd21a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5d9d0>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_a10497e02745e663cd9d5b0077b90de5.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_322af6257224c04f047c694acb93518e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_7f8ded3365d70e93591cbd9d19a83be5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecced0>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b9406543702e1e0e3e78faf359fbd21a.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5e9d0>
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_322af6257224c04f047c694acb93518e.jpg saved to cache
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b73e35a-ca28-5df9-a73a-c0596d187132
2026-04-27 08:08:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b73e35a-ca28-5df9-a73a-c0596d187132, skipping ID generation
2026-04-27 08:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b73e35a-ca28-5df9-a73a-c0596d187132 with scrape type 1
2026-04-27 08:08:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b73e35a-ca28-5df9-a73a-c0596d187132 sending to next pipeline
2026-04-27 08:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b73e35a-ca28-5df9-a73a-c0596d187132, identifier: AN09987
2026-04-27 08:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b73e35a-ca28-5df9-a73a-c0596d187132 with identifier: AN09987
2026-04-27 08:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b73e35a-ca28-5df9-a73a-c0596d187132 with identifier: AN09987
2026-04-27 08:08:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b73e35a-ca28-5df9-a73a-c0596d187132 with identifier: AN09987 to the API
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_322af6257224c04f047c694acb93518e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Schweitenkirchen',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:24:50Z',
 'fuel_type': 'diesel',
 'id': '3b73e35a-ca28-5df9-a73a-c0596d187132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.5033,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN09987',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'location_confidence': 'geocoded',
 'longitude': 11.6045,
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 225999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b9406543702e1e0e3e78faf359fbd21a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_322af6257224c04f047c694acb93518e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_98b0b5c1434e9068a94c6ea615bb4c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_6b59ab2444fcefe3da8901e7c0acca75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_2366ef878fbff2ce75289f80d26057a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_a10497e02745e663cd9d5b0077b90de5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_daee701510641fdefd75c6e47448ab6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e36d6d2d725e82147710793ecf5c16cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_b70d21a3b5fc2d3d52b00dcb87015c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b73e35a-ca28-5df9-a73a-c0596d187132/3b73e35a-ca28-5df9-a73a-c0596d187132_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/79/3b79946ebf8c62209f1d74ef72b46ce6/pa/AN09987_e2780c188b9ce1c4710d11af20347489.jpg',
             'Width': 800}],
 'postal_code': '85301',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2014-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-04-27 08:08:51 [auto1.de] INFO: Saving data for AN09987: {'created_time': 1777277331.358646, 'last_price_update_time': 1777277331.358655, 'has_photos': True, 'auction_closing_time': 1777389890.0}
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5eed0>
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_7f8ded3365d70e93591cbd9d19a83be5.jpg saved to cache
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1
2026-04-27 08:08:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ce6dddd-baac-578d-a923-0c47d4bd42b1, skipping ID generation
2026-04-27 08:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with scrape type 1
2026-04-27 08:08:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ce6dddd-baac-578d-a923-0c47d4bd42b1 sending to next pipeline
2026-04-27 08:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce6dddd-baac-578d-a923-0c47d4bd42b1, identifier: KP66478
2026-04-27 08:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with identifier: KP66478
2026-04-27 08:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with identifier: KP66478
2026-04-27 08:08:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce6dddd-baac-578d-a923-0c47d4bd42b1 with identifier: KP66478 to the API
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_7f8ded3365d70e93591cbd9d19a83be5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'city': 'Buch',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:25:54Z',
 'fuel_type': 'diesel',
 'id': '6ce6dddd-baac-578d-a923-0c47d4bd42b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP66478',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 217908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_7f8ded3365d70e93591cbd9d19a83be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_3ffca50c9aabcdc8fdade8dafebcc863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_fe7b34e7299590b343d465c13389ab9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_bf43c7f45af69579a21c8021940abcc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_217e2f2be99408b0df09fb901eac89cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_a029cf6ee89fcd3174d96d085e23f14b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_de575e4381b369c7d3938f9ff7f10ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_ab7422ac291b7db33644bfc8acb68b2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_4cd9a18d621810a7620ffe58dc575c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ce6dddd-baac-578d-a923-0c47d4bd42b1/6ce6dddd-baac-578d-a923-0c47d4bd42b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4e/fc4e2a8f3479f5efb49aa5f73208ae36/pa/KP66478_b3faa850207884185f6c5af92283693b.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-04-27 08:08:51 [auto1.de] INFO: Saving data for KP66478: {'created_time': 1777277331.785602, 'last_price_update_time': 1777277331.785613, 'has_photos': True, 'auction_closing_time': 1777389954.0}
2026-04-27 08:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR12459> (referer: https://www.auto1.com/v1/car-details-view/HR12459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-04-27 08:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 1
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c6265c1affc9744590368a5c1cb38d38.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_50fcf506c17f108183db7e337159c201.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_d2014f892c64c1378641babb35e6d386.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c9e5fee4b7a2d63dcfac514306395e75.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2710fa3e6fae093efff156a1f3750d5e.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_14f50502f5cc7e4db15685b6fb34053f.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_b1c51743a1b97797087c614874680e5a.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2775296edb11c5783917379b1a23a538.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_f87d466d51f9e9044d04c5749244cff8.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_66ed0217374fcf165a4af595579b9ea7.jpg not downloaded yet
2026-04-27 08:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH81329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_66ed0217374fcf165a4af595579b9ea7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007a190>
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_66ed0217374fcf165a4af595579b9ea7.jpg saved to cache
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_f87d466d51f9e9044d04c5749244cff8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5390>
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_f87d466d51f9e9044d04c5749244cff8.jpg saved to cache
2026-04-27 08:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA49455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2775296edb11c5783917379b1a23a538.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30079910>
2026-04-27 08:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2775296edb11c5783917379b1a23a538.jpg saved to cache
2026-04-27 08:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH32821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_b1c51743a1b97797087c614874680e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG96754> (referer: https://www.auto1.com/v1/car-details-view/PG96754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d3290>
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_b1c51743a1b97797087c614874680e5a.jpg saved to cache
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73db1f2c-700d-590e-96f3-34b5ad75494d with identifier: PG96754
2026-04-27 08:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73db1f2c-700d-590e-96f3-34b5ad75494d with scrape type 1
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ea62f2b1c18910d3c28fc06698ac096a.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_9445f727077a113f43f1b25854ca4501.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_85bcbb709b8f26ef61f343d14aa24642.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_26f66ea407fb4303042f2c8c9e1b0327.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_4fd387397e13d10836fe045b29b2a890.jpg not downloaded yet
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_14f50502f5cc7e4db15685b6fb34053f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_c018a1149cf49121b48fd53257c40424.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_253067a4f61285bbd76a4b9f260eb48b.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_964b28a7380ce9aa24c1f1e52e41686d.jpg not downloaded yet
2026-04-27 08:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ce6fd25ba5e9b596d8fc41b3df774e10.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_5198eba6fde0247ec275c3c8a780cb11.jpg not downloaded yet
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b78350>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_14f50502f5cc7e4db15685b6fb34053f.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_4fd387397e13d10836fe045b29b2a890.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_5198eba6fde0247ec275c3c8a780cb11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4fd50>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_4fd387397e13d10836fe045b29b2a890.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ce6fd25ba5e9b596d8fc41b3df774e10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d3810>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_5198eba6fde0247ec275c3c8a780cb11.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_964b28a7380ce9aa24c1f1e52e41686d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d8290>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ce6fd25ba5e9b596d8fc41b3df774e10.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecf0d0>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_964b28a7380ce9aa24c1f1e52e41686d.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_253067a4f61285bbd76a4b9f260eb48b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b79ed0>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_253067a4f61285bbd76a4b9f260eb48b.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_c018a1149cf49121b48fd53257c40424.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_26f66ea407fb4303042f2c8c9e1b0327.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5a90>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_c018a1149cf49121b48fd53257c40424.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300eab50>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_26f66ea407fb4303042f2c8c9e1b0327.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_85bcbb709b8f26ef61f343d14aa24642.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67450>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_85bcbb709b8f26ef61f343d14aa24642.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_9445f727077a113f43f1b25854ca4501.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ea62f2b1c18910d3c28fc06698ac096a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d28d0>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_9445f727077a113f43f1b25854ca4501.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66cd0>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ea62f2b1c18910d3c28fc06698ac096a.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73db1f2c-700d-590e-96f3-34b5ad75494d
2026-04-27 08:09:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73db1f2c-700d-590e-96f3-34b5ad75494d, skipping ID generation
2026-04-27 08:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73db1f2c-700d-590e-96f3-34b5ad75494d with scrape type 1
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73db1f2c-700d-590e-96f3-34b5ad75494d sending to next pipeline
2026-04-27 08:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73db1f2c-700d-590e-96f3-34b5ad75494d, identifier: PG96754
2026-04-27 08:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73db1f2c-700d-590e-96f3-34b5ad75494d with identifier: PG96754
2026-04-27 08:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73db1f2c-700d-590e-96f3-34b5ad75494d with identifier: PG96754
2026-04-27 08:09:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73db1f2c-700d-590e-96f3-34b5ad75494d with identifier: PG96754 to the API
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ea62f2b1c18910d3c28fc06698ac096a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'city': 'Ketzin',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:40:18Z',
 'fuel_type': 'petrol',
 'id': '73db1f2c-700d-590e-96f3-34b5ad75494d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG96754',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 223549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ea62f2b1c18910d3c28fc06698ac096a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_9445f727077a113f43f1b25854ca4501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_85bcbb709b8f26ef61f343d14aa24642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_26f66ea407fb4303042f2c8c9e1b0327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_4fd387397e13d10836fe045b29b2a890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_c018a1149cf49121b48fd53257c40424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_253067a4f61285bbd76a4b9f260eb48b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_964b28a7380ce9aa24c1f1e52e41686d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_ce6fd25ba5e9b596d8fc41b3df774e10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_73db1f2c-700d-590e-96f3-34b5ad75494d/73db1f2c-700d-590e-96f3-34b5ad75494d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/fb/befb1e2d1e0fb4c5c421474a4383c276/pa/PG96754_5198eba6fde0247ec275c3c8a780cb11.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2009-09-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-04-27 08:09:05 [auto1.de] INFO: Saving data for PG96754: {'created_time': 1777277345.936809, 'last_price_update_time': 1777277345.936819, 'has_photos': True, 'auction_closing_time': 1777390818.0}
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2710fa3e6fae093efff156a1f3750d5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32089990>
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2710fa3e6fae093efff156a1f3750d5e.jpg saved to cache
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c9e5fee4b7a2d63dcfac514306395e75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027bd90>
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c9e5fee4b7a2d63dcfac514306395e75.jpg saved to cache
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_d2014f892c64c1378641babb35e6d386.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3050>
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_d2014f892c64c1378641babb35e6d386.jpg saved to cache
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_50fcf506c17f108183db7e337159c201.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c6265c1affc9744590368a5c1cb38d38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027b010>
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_50fcf506c17f108183db7e337159c201.jpg saved to cache
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3190>
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c6265c1affc9744590368a5c1cb38d38.jpg saved to cache
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b79dba0d-9a6f-594c-853e-b12b81f7cf86
2026-04-27 08:09:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b79dba0d-9a6f-594c-853e-b12b81f7cf86, skipping ID generation
2026-04-27 08:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 1
2026-04-27 08:09:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 sending to next pipeline
2026-04-27 08:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79dba0d-9a6f-594c-853e-b12b81f7cf86, identifier: HR12459
2026-04-27 08:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-04-27 08:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-04-27 08:09:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459 to the API
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c6265c1affc9744590368a5c1cb38d38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:47:39Z',
 'fuel_type': 'diesel',
 'id': 'b79dba0d-9a6f-594c-853e-b12b81f7cf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR12459',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 309344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c6265c1affc9744590368a5c1cb38d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_50fcf506c17f108183db7e337159c201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_d2014f892c64c1378641babb35e6d386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_c9e5fee4b7a2d63dcfac514306395e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2710fa3e6fae093efff156a1f3750d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_14f50502f5cc7e4db15685b6fb34053f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_b1c51743a1b97797087c614874680e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_2775296edb11c5783917379b1a23a538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_f87d466d51f9e9044d04c5749244cff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b79dba0d-9a6f-594c-853e-b12b81f7cf86/b79dba0d-9a6f-594c-853e-b12b81f7cf86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/5e/425e12e1f0b36b710e5ed01ab1a43794/pa/HR12459_66ed0217374fcf165a4af595579b9ea7.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2013-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-04-27 08:09:07 [auto1.de] INFO: Saving data for HR12459: {'created_time': 1777277347.214921, 'last_price_update_time': 1777277347.214934, 'has_photos': True, 'auction_closing_time': 1777391259.0}
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ21212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT05667> (referer: https://www.auto1.com/v1/car-details-view/FT05667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54967288-aa82-5e52-805b-b09853679da8 with identifier: FT05667
2026-04-27 08:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54967288-aa82-5e52-805b-b09853679da8 with scrape type 1
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e91e3258ea79ed4183d6c77b26df335f.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f6972dbf668310fd87f21f040b6fc40a.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_bfb83d3d97d30fe8cdaccded6e2b65da.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2bae64a438581e316f932166c5ab0637.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_d97ac3b578b572c3947279ba70cf69c0.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_1a52dfb4549c6c50293bfa905c323dd2.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_b9ed991fb70a94737e0d933b1d62f9d5.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2edf5812a33011f248653f01781cf85f.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e802eb44120d61c841f94f5c7b0f6895.jpg not downloaded yet
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f51debd9a16c52cb2d56aeed312f7e2f.jpg not downloaded yet
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN91045> (referer: https://www.auto1.com/v1/car-details-view/CN91045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f51debd9a16c52cb2d56aeed312f7e2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-04-27 08:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 1
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_7eb8086fa11ec348bc171ca7472b84eb.jpg not downloaded yet
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_805d7929a7e369e37bb7daaca29b369d.jpg not downloaded yet
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e802eb44120d61c841f94f5c7b0f6895.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_74d2eeaf2c606e9f11a79a9e74c5d561.jpg not downloaded yet
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2714ed8aad6755912c3f7e0d951f3043.jpg not downloaded yet
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_e9a297931ae90be75e8a4b7afd13e9b0.jpg not downloaded yet
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5da50>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f51debd9a16c52cb2d56aeed312f7e2f.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2127d810d39593e2155f71f10d7f56c7.jpg not downloaded yet
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_7eb8086fa11ec348bc171ca7472b84eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f06a90>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e802eb44120d61c841f94f5c7b0f6895.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5bd0>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_7eb8086fa11ec348bc171ca7472b84eb.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_e9a297931ae90be75e8a4b7afd13e9b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d6a710>
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_e9a297931ae90be75e8a4b7afd13e9b0.jpg saved to cache
2026-04-27 08:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2127d810d39593e2155f71f10d7f56c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ba50>
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2127d810d39593e2155f71f10d7f56c7.jpg saved to cache
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2714ed8aad6755912c3f7e0d951f3043.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d2110>
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2714ed8aad6755912c3f7e0d951f3043.jpg saved to cache
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_74d2eeaf2c606e9f11a79a9e74c5d561.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003b7d0>
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_74d2eeaf2c606e9f11a79a9e74c5d561.jpg saved to cache
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_805d7929a7e369e37bb7daaca29b369d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2edf5812a33011f248653f01781cf85f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d4050>
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_805d7929a7e369e37bb7daaca29b369d.jpg saved to cache
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0af9f807-30ca-590c-a7a9-913ce2c6a807
2026-04-27 08:09:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0af9f807-30ca-590c-a7a9-913ce2c6a807, skipping ID generation
2026-04-27 08:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 1
2026-04-27 08:09:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 sending to next pipeline
2026-04-27 08:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9f807-30ca-590c-a7a9-913ce2c6a807, identifier: CN91045
2026-04-27 08:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-04-27 08:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-04-27 08:09:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045 to the API
2026-04-27 08:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_805d7929a7e369e37bb7daaca29b369d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:02:17Z',
 'fuel_type': 'petrol',
 'id': '0af9f807-30ca-590c-a7a9-913ce2c6a807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN91045',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 136643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_7eb8086fa11ec348bc171ca7472b84eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_805d7929a7e369e37bb7daaca29b369d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_74d2eeaf2c606e9f11a79a9e74c5d561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2714ed8aad6755912c3f7e0d951f3043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_e9a297931ae90be75e8a4b7afd13e9b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0af9f807-30ca-590c-a7a9-913ce2c6a807/0af9f807-30ca-590c-a7a9-913ce2c6a807_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/2b/f52b2ad7767de5f9d27954a1078bd75e/pa/CN91045_2127d810d39593e2155f71f10d7f56c7.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2012-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-04-27 08:09:11 [auto1.de] INFO: Saving data for CN91045: {'created_time': 1777277351.981728, 'last_price_update_time': 1777277351.981738, 'has_photos': True, 'auction_closing_time': 1777388537.0}
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_b9ed991fb70a94737e0d933b1d62f9d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cadf90>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2edf5812a33011f248653f01781cf85f.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7190>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_b9ed991fb70a94737e0d933b1d62f9d5.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_1a52dfb4549c6c50293bfa905c323dd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30079490>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_1a52dfb4549c6c50293bfa905c323dd2.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_d97ac3b578b572c3947279ba70cf69c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2bae64a438581e316f932166c5ab0637.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba6610>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_d97ac3b578b572c3947279ba70cf69c0.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cac290>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2bae64a438581e316f932166c5ab0637.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_bfb83d3d97d30fe8cdaccded6e2b65da.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f6972dbf668310fd87f21f040b6fc40a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b7a450>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_bfb83d3d97d30fe8cdaccded6e2b65da.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e91e3258ea79ed4183d6c77b26df335f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67b10>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f6972dbf668310fd87f21f040b6fc40a.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64a50>
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e91e3258ea79ed4183d6c77b26df335f.jpg saved to cache
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54967288-aa82-5e52-805b-b09853679da8
2026-04-27 08:09:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54967288-aa82-5e52-805b-b09853679da8, skipping ID generation
2026-04-27 08:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54967288-aa82-5e52-805b-b09853679da8 with scrape type 1
2026-04-27 08:09:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54967288-aa82-5e52-805b-b09853679da8 sending to next pipeline
2026-04-27 08:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54967288-aa82-5e52-805b-b09853679da8, identifier: FT05667
2026-04-27 08:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54967288-aa82-5e52-805b-b09853679da8 with identifier: FT05667
2026-04-27 08:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54967288-aa82-5e52-805b-b09853679da8 with identifier: FT05667
2026-04-27 08:09:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54967288-aa82-5e52-805b-b09853679da8 with identifier: FT05667 to the API
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e91e3258ea79ed4183d6c77b26df335f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'category': None,
 'city': 'Lahr',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-04-28T15:32:14Z',
 'fuel_type': 'hybrid',
 'id': '54967288-aa82-5e52-805b-b09853679da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.9333,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT05667',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'location_confidence': 'geocoded',
 'longitude': 6.2833,
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 75285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e91e3258ea79ed4183d6c77b26df335f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f6972dbf668310fd87f21f040b6fc40a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_bfb83d3d97d30fe8cdaccded6e2b65da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2bae64a438581e316f932166c5ab0637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_d97ac3b578b572c3947279ba70cf69c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_1a52dfb4549c6c50293bfa905c323dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_b9ed991fb70a94737e0d933b1d62f9d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_2edf5812a33011f248653f01781cf85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_e802eb44120d61c841f94f5c7b0f6895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54967288-aa82-5e52-805b-b09853679da8/54967288-aa82-5e52-805b-b09853679da8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/71/0d71bdca9889990e7620b993f87f169e/pa/FT05667_f51debd9a16c52cb2d56aeed312f7e2f.jpg',
             'Width': 800}],
 'postal_code': '54675',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 e-tron',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-04-27 08:09:13 [auto1.de] INFO: Saving data for FT05667: {'created_time': 1777277353.466284, 'last_price_update_time': 1777277353.466295, 'has_photos': True, 'auction_closing_time': 1777390334.0}
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT28734> (referer: https://www.auto1.com/v1/car-details-view/UT28734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-04-27 08:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with scrape type 1
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_f12da68904ce1eae410519f6ae33aa42.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_399812b8e03ad19ae80728482094a816.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_b04ff4bec87af87a51c8160c7e6fc271.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_09d12b1470c63a94e84d9a272ab46f69.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_c4941aeb90a65eef766fb18e4c7d5169.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_e4fe1959fa7a98c7e099a89fd750e1ae.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_91f48567dc5ec3196ba1bc44037bc6cd.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_65617f2d6d84bdfc7df2abd8167c0d4d.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_89d1001b6bbf7e00a8106350387ef01b.jpg not downloaded yet
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_4c931e3131673bbed389df6090f43293.jpg not downloaded yet
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF94363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_4c931e3131673bbed389df6090f43293.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a557d0>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_4c931e3131673bbed389df6090f43293.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH81329> (referer: https://www.auto1.com/v1/car-details-view/GH81329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_89d1001b6bbf7e00a8106350387ef01b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91b346a-df99-50fc-b2a9-5e0916ca25f6 with identifier: GH81329
2026-04-27 08:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91b346a-df99-50fc-b2a9-5e0916ca25f6 with scrape type 1
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_2f892f7cec6316a5bdad1eaaac99df74.jpg not downloaded yet
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_cfa1967880b29dcf53ccca6aaab447be.jpg not downloaded yet
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_5242ab4609624352d1f78bab258d6d9e.jpg not downloaded yet
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_65617f2d6d84bdfc7df2abd8167c0d4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_f8c974149c23bbc1989dc7acee376556.jpg not downloaded yet
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_63a0044f8db5055900443a104a614911.jpg not downloaded yet
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_13a0fb1a0c7a42353b1f3f918bddf56a.jpg not downloaded yet
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ea710>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_89d1001b6bbf7e00a8106350387ef01b.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4cd10>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_65617f2d6d84bdfc7df2abd8167c0d4d.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_cfa1967880b29dcf53ccca6aaab447be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a78590>
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_cfa1967880b29dcf53ccca6aaab447be.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_13a0fb1a0c7a42353b1f3f918bddf56a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b610>
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_13a0fb1a0c7a42353b1f3f918bddf56a.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_63a0044f8db5055900443a104a614911.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028bf90>
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_63a0044f8db5055900443a104a614911.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_f8c974149c23bbc1989dc7acee376556.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66d50>
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_f8c974149c23bbc1989dc7acee376556.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_5242ab4609624352d1f78bab258d6d9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_2f892f7cec6316a5bdad1eaaac99df74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a57e50>
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_5242ab4609624352d1f78bab258d6d9e.jpg saved to cache
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66d50>
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_2f892f7cec6316a5bdad1eaaac99df74.jpg saved to cache
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a91b346a-df99-50fc-b2a9-5e0916ca25f6
2026-04-27 08:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a91b346a-df99-50fc-b2a9-5e0916ca25f6, skipping ID generation
2026-04-27 08:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91b346a-df99-50fc-b2a9-5e0916ca25f6 with scrape type 1
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a91b346a-df99-50fc-b2a9-5e0916ca25f6 sending to next pipeline
2026-04-27 08:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a91b346a-df99-50fc-b2a9-5e0916ca25f6, identifier: GH81329
2026-04-27 08:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a91b346a-df99-50fc-b2a9-5e0916ca25f6 with identifier: GH81329
2026-04-27 08:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a91b346a-df99-50fc-b2a9-5e0916ca25f6 with identifier: GH81329
2026-04-27 08:09:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a91b346a-df99-50fc-b2a9-5e0916ca25f6 with identifier: GH81329 to the API
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_2f892f7cec6316a5bdad1eaaac99df74.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'city': 'Kerpen',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-04-28T15:29:45Z',
 'fuel_type': 'petrol',
 'id': 'a91b346a-df99-50fc-b2a9-5e0916ca25f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH81329',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 193594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_2f892f7cec6316a5bdad1eaaac99df74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_cfa1967880b29dcf53ccca6aaab447be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_5242ab4609624352d1f78bab258d6d9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_f8c974149c23bbc1989dc7acee376556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_63a0044f8db5055900443a104a614911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a91b346a-df99-50fc-b2a9-5e0916ca25f6/a91b346a-df99-50fc-b2a9-5e0916ca25f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/91/a791ea398b8e0f5c4e76b55c69437756/pa/GH81329_13a0fb1a0c7a42353b1f3f918bddf56a.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2011-10-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-04-27 08:09:24 [auto1.de] INFO: Saving data for GH81329: {'created_time': 1777277364.756436, 'last_price_update_time': 1777277364.756449, 'has_photos': True, 'auction_closing_time': 1777390185.0}
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_91f48567dc5ec3196ba1bc44037bc6cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA49455> (referer: https://www.auto1.com/v1/car-details-view/PA49455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a8190>
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_91f48567dc5ec3196ba1bc44037bc6cd.jpg saved to cache
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_e4fe1959fa7a98c7e099a89fd750e1ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with identifier: PA49455
2026-04-27 08:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with scrape type 1
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_294e6a701eb79723ee625ef456c508a1.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_2c718d9fefd8de7b2565625963c1d56f.jpg not downloaded yet
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_e98281f882a8928eced049a28fdb6ae3.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_64b17a8eebf3aaf3b7d59c9fac710616.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_3deb3662bed9a776140b9c683f6f0139.jpg not downloaded yet
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_09d12b1470c63a94e84d9a272ab46f69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_9e1d4e6a29f6aa343e8adcf3d8b65362.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_fc55ef0fad249ad5df8aaf79eb173022.jpg not downloaded yet
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_d0c814e6fcc401902670c28c01ddcaa9.jpg not downloaded yet
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_c4941aeb90a65eef766fb18e4c7d5169.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_201d971571c04b5a8318218d1082919e.jpg not downloaded yet
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ee88ad0>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_e4fe1959fa7a98c7e099a89fd750e1ae.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_6df4173ba31155ae5ca44e73ba5e01a9.jpg not downloaded yet
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44950>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_09d12b1470c63a94e84d9a272ab46f69.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d634d0>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_c4941aeb90a65eef766fb18e4c7d5169.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_3deb3662bed9a776140b9c683f6f0139.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_d0c814e6fcc401902670c28c01ddcaa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d61890>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_3deb3662bed9a776140b9c683f6f0139.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a59190>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_d0c814e6fcc401902670c28c01ddcaa9.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_201d971571c04b5a8318218d1082919e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_6df4173ba31155ae5ca44e73ba5e01a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d80e10>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_201d971571c04b5a8318218d1082919e.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecddd0>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_6df4173ba31155ae5ca44e73ba5e01a9.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_fc55ef0fad249ad5df8aaf79eb173022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_9e1d4e6a29f6aa343e8adcf3d8b65362.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH94739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e0ab10>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_fc55ef0fad249ad5df8aaf79eb173022.jpg saved to cache
2026-04-27 08:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM98410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_64b17a8eebf3aaf3b7d59c9fac710616.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4f890>
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_9e1d4e6a29f6aa343e8adcf3d8b65362.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH32821> (referer: https://www.auto1.com/v1/car-details-view/YH32821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_294e6a701eb79723ee625ef456c508a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_2c718d9fefd8de7b2565625963c1d56f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba6ed0>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_64b17a8eebf3aaf3b7d59c9fac710616.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_399812b8e03ad19ae80728482094a816.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_e98281f882a8928eced049a28fdb6ae3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_f12da68904ce1eae410519f6ae33aa42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062294d0-f4b8-5018-91ae-0cda8e389254 with identifier: YH32821
2026-04-27 08:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062294d0-f4b8-5018-91ae-0cda8e389254 with scrape type 1
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_dda682e3e5caba0b21c43c24dd0ed054.jpg not downloaded yet
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_56328947635d8621d590ff6f2601427c.jpg not downloaded yet
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_02ca32f043d42d6a95ef4d4a5ca82655.jpg not downloaded yet
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cacf50>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_294e6a701eb79723ee625ef456c508a1.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e925d0>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_2c718d9fefd8de7b2565625963c1d56f.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_9276a997281544cf3e2c788ffbff985b.jpg not downloaded yet
2026-04-27 08:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_b04ff4bec87af87a51c8160c7e6fc271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_a26fede105ee0dab62e21a3fa2d7e749.jpg not downloaded yet
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_73953fab94eb1f1b5b2eb1f12ac905e8.jpg not downloaded yet
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8e610>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_399812b8e03ad19ae80728482094a816.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e405d0>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_e98281f882a8928eced049a28fdb6ae3.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc
2026-04-27 08:09:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc, skipping ID generation
2026-04-27 08:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with scrape type 1
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc sending to next pipeline
2026-04-27 08:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc, identifier: PA49455
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b83dd0>
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_f12da68904ce1eae410519f6ae33aa42.jpg saved to cache
2026-04-27 08:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with identifier: PA49455
2026-04-27 08:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with identifier: PA49455
2026-04-27 08:09:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc with identifier: PA49455 to the API
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_e98281f882a8928eced049a28fdb6ae3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'city': 'Kerpen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:41:20Z',
 'fuel_type': 'petrol',
 'id': '9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA49455',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 2561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_294e6a701eb79723ee625ef456c508a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_2c718d9fefd8de7b2565625963c1d56f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_e98281f882a8928eced049a28fdb6ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_64b17a8eebf3aaf3b7d59c9fac710616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_3deb3662bed9a776140b9c683f6f0139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_9e1d4e6a29f6aa343e8adcf3d8b65362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_fc55ef0fad249ad5df8aaf79eb173022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_d0c814e6fcc401902670c28c01ddcaa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_201d971571c04b5a8318218d1082919e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc/9fa18769-00f6-5e4a-9bd0-0dc7609e2bdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/43/1b43086afabc33f80303f4730add6b36/pa/PA49455_6df4173ba31155ae5ca44e73ba5e01a9.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2023-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2023}
2026-04-27 08:09:27 [auto1.de] INFO: Saving data for PA49455: {'created_time': 1777277367.000288, 'last_price_update_time': 1777277367.000301, 'has_photos': True, 'auction_closing_time': 1777390880.0}
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_963a092ac48368aed463683fd2a58aa4.jpg not downloaded yet
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_02ca32f043d42d6a95ef4d4a5ca82655.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_5a74911cc343d0b000557ca91848ddbe.jpg not downloaded yet
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30197610>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_b04ff4bec87af87a51c8160c7e6fc271.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d
2026-04-27 08:09:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d, skipping ID generation
2026-04-27 08:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with scrape type 1
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d sending to next pipeline
2026-04-27 08:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d, identifier: UT28734
2026-04-27 08:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-04-27 08:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-04-27 08:09:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734 to the API
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_b04ff4bec87af87a51c8160c7e6fc271.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-04-28T15:23:02Z',
 'fuel_type': 'diesel',
 'id': '69b0be66-4ad9-5d50-b17a-3c3a11f3256d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT28734',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 274121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_f12da68904ce1eae410519f6ae33aa42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_399812b8e03ad19ae80728482094a816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_b04ff4bec87af87a51c8160c7e6fc271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_09d12b1470c63a94e84d9a272ab46f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_c4941aeb90a65eef766fb18e4c7d5169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_e4fe1959fa7a98c7e099a89fd750e1ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_91f48567dc5ec3196ba1bc44037bc6cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_65617f2d6d84bdfc7df2abd8167c0d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_89d1001b6bbf7e00a8106350387ef01b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_69b0be66-4ad9-5d50-b17a-3c3a11f3256d/69b0be66-4ad9-5d50-b17a-3c3a11f3256d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/56/8d56a7052a23a0fb9e4fd14da282ceae/pa/UT28734_4c931e3131673bbed389df6090f43293.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2011-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2011}
2026-04-27 08:09:27 [auto1.de] INFO: Saving data for UT28734: {'created_time': 1777277367.583379, 'last_price_update_time': 1777277367.583389, 'has_photos': True, 'auction_closing_time': 1777389782.0}
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_001671b8017ff226f5ea613019be0338.jpg not downloaded yet
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a71e50>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_02ca32f043d42d6a95ef4d4a5ca82655.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_73953fab94eb1f1b5b2eb1f12ac905e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_444ec9eb7af9a016dcf5a8d3be0fdd14.jpg not downloaded yet
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_001671b8017ff226f5ea613019be0338.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3990>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_73953fab94eb1f1b5b2eb1f12ac905e8.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027ac50>
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_001671b8017ff226f5ea613019be0338.jpg saved to cache
2026-04-27 08:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_444ec9eb7af9a016dcf5a8d3be0fdd14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_5a74911cc343d0b000557ca91848ddbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d9310>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_444ec9eb7af9a016dcf5a8d3be0fdd14.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cadf50>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_5a74911cc343d0b000557ca91848ddbe.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_963a092ac48368aed463683fd2a58aa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca2310>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_963a092ac48368aed463683fd2a58aa4.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_a26fede105ee0dab62e21a3fa2d7e749.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV23650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300add90>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_a26fede105ee0dab62e21a3fa2d7e749.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_9276a997281544cf3e2c788ffbff985b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_dda682e3e5caba0b21c43c24dd0ed054.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_56328947635d8621d590ff6f2601427c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f698d0>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_9276a997281544cf3e2c788ffbff985b.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65450>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_dda682e3e5caba0b21c43c24dd0ed054.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3890>
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_56328947635d8621d590ff6f2601427c.jpg saved to cache
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 062294d0-f4b8-5018-91ae-0cda8e389254
2026-04-27 08:09:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 062294d0-f4b8-5018-91ae-0cda8e389254, skipping ID generation
2026-04-27 08:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062294d0-f4b8-5018-91ae-0cda8e389254 with scrape type 1
2026-04-27 08:09:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 062294d0-f4b8-5018-91ae-0cda8e389254 sending to next pipeline
2026-04-27 08:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 062294d0-f4b8-5018-91ae-0cda8e389254, identifier: YH32821
2026-04-27 08:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 062294d0-f4b8-5018-91ae-0cda8e389254 with identifier: YH32821
2026-04-27 08:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 062294d0-f4b8-5018-91ae-0cda8e389254 with identifier: YH32821
2026-04-27 08:09:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 062294d0-f4b8-5018-91ae-0cda8e389254 with identifier: YH32821 to the API
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_56328947635d8621d590ff6f2601427c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Langenselbold',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:52:45Z',
 'fuel_type': 'petrol',
 'id': '062294d0-f4b8-5018-91ae-0cda8e389254',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.1766,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH32821',
 'listing': 'auction',
 'location': 'DE, Langenselbold',
 'location_confidence': 'geocoded',
 'longitude': 9.04,
 'make': 'BMW',
 'model': '2er',
 'odometer': 117735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_dda682e3e5caba0b21c43c24dd0ed054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_56328947635d8621d590ff6f2601427c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_02ca32f043d42d6a95ef4d4a5ca82655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_9276a997281544cf3e2c788ffbff985b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_a26fede105ee0dab62e21a3fa2d7e749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_73953fab94eb1f1b5b2eb1f12ac905e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_963a092ac48368aed463683fd2a58aa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_5a74911cc343d0b000557ca91848ddbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_001671b8017ff226f5ea613019be0338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_062294d0-f4b8-5018-91ae-0cda8e389254/062294d0-f4b8-5018-91ae-0cda8e389254_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/93/c89386742f12bbcfe224b8e72cd40eba/pa/YH32821_444ec9eb7af9a016dcf5a8d3be0fdd14.jpg',
             'Width': 800}],
 'postal_code': '63505',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2018-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-04-27 08:09:29 [auto1.de] INFO: Saving data for YH32821: {'created_time': 1777277369.335267, 'last_price_update_time': 1777277369.335276, 'has_photos': True, 'auction_closing_time': 1777391565.0}
2026-04-27 08:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ21212> (referer: https://www.auto1.com/v1/car-details-view/NJ21212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-04-27 08:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with scrape type 1
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_17932c19bf8d6423ce5eedc318becf3d.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d2d5f4893a609bb758ea8ee8942c1753.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_c6bf5593de4c8edc0d80cbce82de517a.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_fde2778dc9465b9f1d871fb6a36066d5.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_0ec518c205113e4ef960a6cba3c4a9d4.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_44914ad3bad70f15f0c54324a704406b.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_4cd623001f9672fe0e0da119179c31a4.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_5f9d590914ca38b6e51cee2a69c9af0d.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d88d85790eac0bc55dcaa7bc0fa46f8b.jpg not downloaded yet
2026-04-27 08:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_24db4e3bf085f3c7773c7bf56dc14fa4.jpg not downloaded yet
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY20186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_24db4e3bf085f3c7773c7bf56dc14fa4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP81002> (referer: https://www.auto1.com/v1/car-details-view/UP81002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cac090>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_24db4e3bf085f3c7773c7bf56dc14fa4.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1645c8d-886b-5f59-9798-f9538704f4be with identifier: UP81002
2026-04-27 08:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1645c8d-886b-5f59-9798-f9538704f4be with scrape type 1
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_6fd617afe1e63a2d70e10b8432dea2fb.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_bbd8b08d57c8e27f1107a1b9042b72d1.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_c8e5935e9f4ce9c82af7c47ef721d3b4.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_79fb09adf4485dba268152730652e2e7.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_14ece5201388ca553e4f884e6a5c7d39.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_16ddf95537b0ad92fff4ff6a68087134.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_92b867970fe31a59f03211295cb920ec.jpg not downloaded yet
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d88d85790eac0bc55dcaa7bc0fa46f8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_18bf106a621791ee1e4a430d7ede99dc.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_8cb945c079431e81df47c8f028e16c5f.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_f8a49b0a91271e5a5d02f0304d0b0539.jpg not downloaded yet
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0d2d0>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d88d85790eac0bc55dcaa7bc0fa46f8b.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_92b867970fe31a59f03211295cb920ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65890>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_92b867970fe31a59f03211295cb920ec.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_f8a49b0a91271e5a5d02f0304d0b0539.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cae310>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_f8a49b0a91271e5a5d02f0304d0b0539.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_8cb945c079431e81df47c8f028e16c5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_18bf106a621791ee1e4a430d7ede99dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300932d0>
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_8cb945c079431e81df47c8f028e16c5f.jpg saved to cache
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ac750>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_18bf106a621791ee1e4a430d7ede99dc.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_16ddf95537b0ad92fff4ff6a68087134.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_14ece5201388ca553e4f884e6a5c7d39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018bb90>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_16ddf95537b0ad92fff4ff6a68087134.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_79fb09adf4485dba268152730652e2e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0c1d0>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_14ece5201388ca553e4f884e6a5c7d39.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_c8e5935e9f4ce9c82af7c47ef721d3b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2690>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_79fb09adf4485dba268152730652e2e7.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0db50>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_c8e5935e9f4ce9c82af7c47ef721d3b4.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_bbd8b08d57c8e27f1107a1b9042b72d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_6fd617afe1e63a2d70e10b8432dea2fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d81e10>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_bbd8b08d57c8e27f1107a1b9042b72d1.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4f250>
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_6fd617afe1e63a2d70e10b8432dea2fb.jpg saved to cache
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1645c8d-886b-5f59-9798-f9538704f4be
2026-04-27 08:09:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1645c8d-886b-5f59-9798-f9538704f4be, skipping ID generation
2026-04-27 08:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1645c8d-886b-5f59-9798-f9538704f4be with scrape type 1
2026-04-27 08:09:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1645c8d-886b-5f59-9798-f9538704f4be sending to next pipeline
2026-04-27 08:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1645c8d-886b-5f59-9798-f9538704f4be, identifier: UP81002
2026-04-27 08:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1645c8d-886b-5f59-9798-f9538704f4be with identifier: UP81002
2026-04-27 08:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1645c8d-886b-5f59-9798-f9538704f4be with identifier: UP81002
2026-04-27 08:09:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1645c8d-886b-5f59-9798-f9538704f4be with identifier: UP81002 to the API
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_6fd617afe1e63a2d70e10b8432dea2fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'city': 'Kerpen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:06:52Z',
 'fuel_type': 'petrol',
 'id': 'a1645c8d-886b-5f59-9798-f9538704f4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP81002',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 75175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_6fd617afe1e63a2d70e10b8432dea2fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_bbd8b08d57c8e27f1107a1b9042b72d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_c8e5935e9f4ce9c82af7c47ef721d3b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_79fb09adf4485dba268152730652e2e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_14ece5201388ca553e4f884e6a5c7d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_16ddf95537b0ad92fff4ff6a68087134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_92b867970fe31a59f03211295cb920ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_18bf106a621791ee1e4a430d7ede99dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_8cb945c079431e81df47c8f028e16c5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1645c8d-886b-5f59-9798-f9538704f4be/a1645c8d-886b-5f59-9798-f9538704f4be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/42/c142be533b43091287c181155f0b553b/pa/UP81002_f8a49b0a91271e5a5d02f0304d0b0539.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-04-27 08:09:34 [auto1.de] INFO: Saving data for UP81002: {'created_time': 1777277374.341815, 'last_price_update_time': 1777277374.341827, 'has_photos': True, 'auction_closing_time': 1777388812.0}
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_5f9d590914ca38b6e51cee2a69c9af0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH94739> (referer: https://www.auto1.com/v1/car-details-view/SH94739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018b810>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_5f9d590914ca38b6e51cee2a69c9af0d.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-04-27 08:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a0910d-e5a1-58c8-b384-86103bb84eaa with scrape type 1
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2f892f8bb377bb67cae837d3f23b382e.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_d284c2bca5c0d8572858ffdfd970c664.jpg not downloaded yet
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_4cd623001f9672fe0e0da119179c31a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_11488264c88bd2140de11e0ab65e5f97.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5370c82a089a7dd03327d9fd116de71f.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_acba50c23171c16f8abd84f7f92c87cf.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_59c82415293ca5023274f11ff4153633.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2ec37aa73bc2451d74f7282dd41ae8aa.jpg not downloaded yet
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_44914ad3bad70f15f0c54324a704406b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5f0062d5412eea909b73340a2d23fe44.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_ff683eb2cda6fdc1f744ea273d4e2d65.jpg not downloaded yet
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_02ae9e92fde7d7e502303afcc3800fd1.jpg not downloaded yet
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301a8c90>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_4cd623001f9672fe0e0da119179c31a4.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c37190>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_44914ad3bad70f15f0c54324a704406b.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_d284c2bca5c0d8572858ffdfd970c664.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0550>
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_d284c2bca5c0d8572858ffdfd970c664.jpg saved to cache
2026-04-27 08:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2ec37aa73bc2451d74f7282dd41ae8aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_02ae9e92fde7d7e502303afcc3800fd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e909d0>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2ec37aa73bc2451d74f7282dd41ae8aa.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91b50>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_02ae9e92fde7d7e502303afcc3800fd1.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5f0062d5412eea909b73340a2d23fe44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_ff683eb2cda6fdc1f744ea273d4e2d65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75110>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5f0062d5412eea909b73340a2d23fe44.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30195c90>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_ff683eb2cda6fdc1f744ea273d4e2d65.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_59c82415293ca5023274f11ff4153633.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_acba50c23171c16f8abd84f7f92c87cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b064d0>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_59c82415293ca5023274f11ff4153633.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b83490>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_acba50c23171c16f8abd84f7f92c87cf.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5370c82a089a7dd03327d9fd116de71f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_11488264c88bd2140de11e0ab65e5f97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2f892f8bb377bb67cae837d3f23b382e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1850>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5370c82a089a7dd03327d9fd116de71f.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b650d0>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_11488264c88bd2140de11e0ab65e5f97.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b82c10>
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2f892f8bb377bb67cae837d3f23b382e.jpg saved to cache
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47a0910d-e5a1-58c8-b384-86103bb84eaa
2026-04-27 08:09:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47a0910d-e5a1-58c8-b384-86103bb84eaa, skipping ID generation
2026-04-27 08:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a0910d-e5a1-58c8-b384-86103bb84eaa with scrape type 1
2026-04-27 08:09:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47a0910d-e5a1-58c8-b384-86103bb84eaa sending to next pipeline
2026-04-27 08:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47a0910d-e5a1-58c8-b384-86103bb84eaa, identifier: SH94739
2026-04-27 08:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-04-27 08:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-04-27 08:09:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739 to the API
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2f892f8bb377bb67cae837d3f23b382e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'city': 'Seddiner See',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:54:55Z',
 'fuel_type': 'petrol',
 'id': '47a0910d-e5a1-58c8-b384-86103bb84eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH94739',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 88780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2f892f8bb377bb67cae837d3f23b382e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_d284c2bca5c0d8572858ffdfd970c664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_11488264c88bd2140de11e0ab65e5f97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5370c82a089a7dd03327d9fd116de71f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_acba50c23171c16f8abd84f7f92c87cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_59c82415293ca5023274f11ff4153633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_2ec37aa73bc2451d74f7282dd41ae8aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_5f0062d5412eea909b73340a2d23fe44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_ff683eb2cda6fdc1f744ea273d4e2d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47a0910d-e5a1-58c8-b384-86103bb84eaa/47a0910d-e5a1-58c8-b384-86103bb84eaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1c/1e1c2e24846bf4282c03fa7dea58e690/pa/SH94739_02ae9e92fde7d7e502303afcc3800fd1.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2012-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-04-27 08:09:36 [auto1.de] INFO: Saving data for SH94739: {'created_time': 1777277376.449287, 'last_price_update_time': 1777277376.449295, 'has_photos': True, 'auction_closing_time': 1777391695.0}
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_fde2778dc9465b9f1d871fb6a36066d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_0ec518c205113e4ef960a6cba3c4a9d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF94363> (referer: https://www.auto1.com/v1/car-details-view/XF94363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_17932c19bf8d6423ce5eedc318becf3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0d190>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_fde2778dc9465b9f1d871fb6a36066d5.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad2d0>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_0ec518c205113e4ef960a6cba3c4a9d4.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-04-27 08:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with scrape type 1
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_cac72335e43799e35de7c3b39a6929e4.jpg not downloaded yet
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_dc8679d6642ef4ea1a85600b1dd7bd4d.jpg not downloaded yet
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_c6bf5593de4c8edc0d80cbce82de517a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d2d5f4893a609bb758ea8ee8942c1753.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_3ed09f49aa23791f324e4de6e703ae66.jpg not downloaded yet
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30195590>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_17932c19bf8d6423ce5eedc318becf3d.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_5b1610b179a5e2fcbc4d13b286a7a56b.jpg not downloaded yet
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8eb23df5607c1a82d07ca4007da65445.jpg not downloaded yet
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_0f2592f232bca24fd1407f18a6660138.jpg not downloaded yet
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_878c11638414e515b6faa7cc5ca86b40.jpg not downloaded yet
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07190>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_c6bf5593de4c8edc0d80cbce82de517a.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5b290>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d2d5f4893a609bb758ea8ee8942c1753.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6
2026-04-27 08:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41c3e7dc-ee89-5b73-a140-a58ab841cce6, skipping ID generation
2026-04-27 08:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with scrape type 1
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6 sending to next pipeline
2026-04-27 08:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c3e7dc-ee89-5b73-a140-a58ab841cce6, identifier: NJ21212
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_dc8679d6642ef4ea1a85600b1dd7bd4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_cac72335e43799e35de7c3b39a6929e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d67d00e3de636f852d1e3061c85a70cc.jpg not downloaded yet
2026-04-27 08:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-04-27 08:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-04-27 08:09:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212 to the API
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d2d5f4893a609bb758ea8ee8942c1753.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Schweitenkirchen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:26:42Z',
 'fuel_type': 'diesel',
 'id': '41c3e7dc-ee89-5b73-a140-a58ab841cce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.5033,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ21212',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'location_confidence': 'geocoded',
 'longitude': 11.6045,
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 164288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_17932c19bf8d6423ce5eedc318becf3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d2d5f4893a609bb758ea8ee8942c1753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_c6bf5593de4c8edc0d80cbce82de517a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_fde2778dc9465b9f1d871fb6a36066d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_0ec518c205113e4ef960a6cba3c4a9d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_44914ad3bad70f15f0c54324a704406b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_4cd623001f9672fe0e0da119179c31a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_5f9d590914ca38b6e51cee2a69c9af0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_d88d85790eac0bc55dcaa7bc0fa46f8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_41c3e7dc-ee89-5b73-a140-a58ab841cce6/41c3e7dc-ee89-5b73-a140-a58ab841cce6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c044fc9069e36d323085be731f92a61a/pa/NJ21212_24db4e3bf085f3c7773c7bf56dc14fa4.jpg',
             'Width': 800}],
 'postal_code': '85301',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2015-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 2.2 DI-D Comfort Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Comfort Edition 4WD',
 'year': 2015}
2026-04-27 08:09:37 [auto1.de] INFO: Saving data for NJ21212: {'created_time': 1777277377.581349, 'last_price_update_time': 1777277377.58136, 'has_photos': True, 'auction_closing_time': 1777390002.0}
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d8b2edde378118b44767a32b9aa32603.jpg not downloaded yet
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8afb589d6c4f933161c3343971c0212e.jpg not downloaded yet
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fea010>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_dc8679d6642ef4ea1a85600b1dd7bd4d.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22caf050>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_cac72335e43799e35de7c3b39a6929e4.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_878c11638414e515b6faa7cc5ca86b40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_0f2592f232bca24fd1407f18a6660138.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14290>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_878c11638414e515b6faa7cc5ca86b40.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dce410>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_0f2592f232bca24fd1407f18a6660138.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8afb589d6c4f933161c3343971c0212e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d67d00e3de636f852d1e3061c85a70cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d8b2edde378118b44767a32b9aa32603.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f0910>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8afb589d6c4f933161c3343971c0212e.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f1110>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d67d00e3de636f852d1e3061c85a70cc.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3290>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d8b2edde378118b44767a32b9aa32603.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_5b1610b179a5e2fcbc4d13b286a7a56b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8eb23df5607c1a82d07ca4007da65445.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e920d0>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_5b1610b179a5e2fcbc4d13b286a7a56b.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a28ad0>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8eb23df5607c1a82d07ca4007da65445.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_3ed09f49aa23791f324e4de6e703ae66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a56450>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_3ed09f49aa23791f324e4de6e703ae66.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161
2026-04-27 08:09:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161, skipping ID generation
2026-04-27 08:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with scrape type 1
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 sending to next pipeline
2026-04-27 08:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161, identifier: XF94363
2026-04-27 08:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-04-27 08:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-04-27 08:09:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363 to the API
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_3ed09f49aa23791f324e4de6e703ae66.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'city': 'Dortmund',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-04-28T15:08:37Z',
 'fuel_type': 'diesel',
 'id': '6d991e2d-eede-5ad3-a60b-28b0f5bc5161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF94363',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 200489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_cac72335e43799e35de7c3b39a6929e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_dc8679d6642ef4ea1a85600b1dd7bd4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_3ed09f49aa23791f324e4de6e703ae66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_5b1610b179a5e2fcbc4d13b286a7a56b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8eb23df5607c1a82d07ca4007da65445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_0f2592f232bca24fd1407f18a6660138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_878c11638414e515b6faa7cc5ca86b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d67d00e3de636f852d1e3061c85a70cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_d8b2edde378118b44767a32b9aa32603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6d991e2d-eede-5ad3-a60b-28b0f5bc5161/6d991e2d-eede-5ad3-a60b-28b0f5bc5161_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/c2/04c2534d0d8591a3bc5a202b1252e8e9/pa/XF94363_8afb589d6c4f933161c3343971c0212e.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-04-27 08:09:39 [auto1.de] INFO: Saving data for XF94363: {'created_time': 1777277379.036682, 'last_price_update_time': 1777277379.036691, 'has_photos': True, 'auction_closing_time': 1777388917.0}
2026-04-27 08:09:43 [scrapy.extensions.logstats] INFO: Crawled 642 pages (at 31 pages/min), scraped 286 items (at 15 items/min)
2026-04-27 08:09:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM98410> (referer: https://www.auto1.com/v1/car-details-view/MM98410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-04-27 08:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2acefe-b77b-55fd-ba68-beb206535018 with scrape type 1
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_00b9ab240e02da7b8746f50e4a7603b7.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_a55cf72922c167849e630dfcfe3dc37f.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_acfc3b63ce32ce9211e3b0b4b7a237b0.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_4b621b3aaaa927b08028c927091552b7.jpg not downloaded yet
2026-04-27 08:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_3713635bf5d701f0e25c05ceb28bd7cc.jpg not downloaded yet
2026-04-27 08:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ21667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_3713635bf5d701f0e25c05ceb28bd7cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e17ad0>
2026-04-27 08:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_3713635bf5d701f0e25c05ceb28bd7cc.jpg saved to cache
2026-04-27 08:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV23650> (referer: https://www.auto1.com/v1/car-details-view/BV23650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0310445-d4c4-5907-a794-4094b4a0e272 with identifier: BV23650
2026-04-27 08:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0310445-d4c4-5907-a794-4094b4a0e272 with scrape type 1
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_678eecf9dce7507b6eca29d285c15c1a.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_2030638af77a6cc814a972dda4ca7bf6.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_e3f418d7f5a27039d1e2d0a4e218ad7f.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_56596b324957d12a7bfcf0dd487be98e.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_df974fd3acfb162909c21d8db516c6d2.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_04c24a232d4f568f9539c9d1b1fc5e69.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_9256cc2020145d482acb96abc8e7ecb0.jpg not downloaded yet
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_4b621b3aaaa927b08028c927091552b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_8d87929f9f3af49544b70578bafc27ad.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_fdc80c9287dda524df8c89e928280741.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_26a94b04e8b1222b691c8866500baa3d.jpg not downloaded yet
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e16010>
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_4b621b3aaaa927b08028c927091552b7.jpg saved to cache
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_9256cc2020145d482acb96abc8e7ecb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c0510>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_9256cc2020145d482acb96abc8e7ecb0.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_26a94b04e8b1222b691c8866500baa3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f3410>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_26a94b04e8b1222b691c8866500baa3d.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_fdc80c9287dda524df8c89e928280741.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb09d0>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_fdc80c9287dda524df8c89e928280741.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_8d87929f9f3af49544b70578bafc27ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a56dd0>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_8d87929f9f3af49544b70578bafc27ad.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_04c24a232d4f568f9539c9d1b1fc5e69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0dbd0>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_04c24a232d4f568f9539c9d1b1fc5e69.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_df974fd3acfb162909c21d8db516c6d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c34710>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_df974fd3acfb162909c21d8db516c6d2.jpg saved to cache
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_56596b324957d12a7bfcf0dd487be98e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1dd0>
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_56596b324957d12a7bfcf0dd487be98e.jpg saved to cache
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_e3f418d7f5a27039d1e2d0a4e218ad7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc2090>
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_e3f418d7f5a27039d1e2d0a4e218ad7f.jpg saved to cache
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_2030638af77a6cc814a972dda4ca7bf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f2710>
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_2030638af77a6cc814a972dda4ca7bf6.jpg saved to cache
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_678eecf9dce7507b6eca29d285c15c1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca0a10>
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_678eecf9dce7507b6eca29d285c15c1a.jpg saved to cache
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0310445-d4c4-5907-a794-4094b4a0e272
2026-04-27 08:09:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0310445-d4c4-5907-a794-4094b4a0e272, skipping ID generation
2026-04-27 08:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0310445-d4c4-5907-a794-4094b4a0e272 with scrape type 1
2026-04-27 08:09:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0310445-d4c4-5907-a794-4094b4a0e272 sending to next pipeline
2026-04-27 08:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0310445-d4c4-5907-a794-4094b4a0e272, identifier: BV23650
2026-04-27 08:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0310445-d4c4-5907-a794-4094b4a0e272 with identifier: BV23650
2026-04-27 08:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0310445-d4c4-5907-a794-4094b4a0e272 with identifier: BV23650
2026-04-27 08:09:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0310445-d4c4-5907-a794-4094b4a0e272 with identifier: BV23650 to the API
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_678eecf9dce7507b6eca29d285c15c1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'city': 'Ellerau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:49:24Z',
 'fuel_type': 'diesel',
 'id': 'c0310445-d4c4-5907-a794-4094b4a0e272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV23650',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 151022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_678eecf9dce7507b6eca29d285c15c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_2030638af77a6cc814a972dda4ca7bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_e3f418d7f5a27039d1e2d0a4e218ad7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_56596b324957d12a7bfcf0dd487be98e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_df974fd3acfb162909c21d8db516c6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_04c24a232d4f568f9539c9d1b1fc5e69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_9256cc2020145d482acb96abc8e7ecb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_8d87929f9f3af49544b70578bafc27ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_fdc80c9287dda524df8c89e928280741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0310445-d4c4-5907-a794-4094b4a0e272/c0310445-d4c4-5907-a794-4094b4a0e272_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/7d/2a7db4a8c5bd956016c2bd1c69dab842/pa/BV23650_26a94b04e8b1222b691c8866500baa3d.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2014-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2014}
2026-04-27 08:09:56 [auto1.de] INFO: Saving data for BV23650: {'created_time': 1777277396.371037, 'last_price_update_time': 1777277396.37105, 'has_photos': True, 'auction_closing_time': 1777391364.0}
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_acfc3b63ce32ce9211e3b0b4b7a237b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c34410>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_acfc3b63ce32ce9211e3b0b4b7a237b0.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_a55cf72922c167849e630dfcfe3dc37f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_00b9ab240e02da7b8746f50e4a7603b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3027b750>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_a55cf72922c167849e630dfcfe3dc37f.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5b0d0>
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_00b9ab240e02da7b8746f50e4a7603b7.jpg saved to cache
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e2acefe-b77b-55fd-ba68-beb206535018
2026-04-27 08:09:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e2acefe-b77b-55fd-ba68-beb206535018, skipping ID generation
2026-04-27 08:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2acefe-b77b-55fd-ba68-beb206535018 with scrape type 1
2026-04-27 08:09:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e2acefe-b77b-55fd-ba68-beb206535018 sending to next pipeline
2026-04-27 08:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e2acefe-b77b-55fd-ba68-beb206535018, identifier: MM98410
2026-04-27 08:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-04-27 08:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-04-27 08:09:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410 to the API
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_00b9ab240e02da7b8746f50e4a7603b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Kandel',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO N\\/A',
 'engine': '2.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-04-28T15:13:11Z',
 'fuel_type': 'petrol',
 'id': '4e2acefe-b77b-55fd-ba68-beb206535018',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM98410',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_00b9ab240e02da7b8746f50e4a7603b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_a55cf72922c167849e630dfcfe3dc37f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_acfc3b63ce32ce9211e3b0b4b7a237b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_4b621b3aaaa927b08028c927091552b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e2acefe-b77b-55fd-ba68-beb206535018/4e2acefe-b77b-55fd-ba68-beb206535018_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/3a/ba3aba6cff3c866af9b20f3f1bf9b63e/pa/MM98410_3713635bf5d701f0e25c05ceb28bd7cc.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2009-01-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Jeep Compass 2.4 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2009}
2026-04-27 08:09:57 [auto1.de] INFO: Saving data for MM98410: {'created_time': 1777277397.224298, 'last_price_update_time': 1777277397.22431, 'has_photos': True, 'auction_closing_time': 1777389191.0}
2026-04-27 08:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK59952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY77324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK76037/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY20186> (referer: https://www.auto1.com/v1/car-details-view/JY20186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS72141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-04-27 08:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 1
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_68c913ed14038761e8a873df765ba6b8.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_fee2b0ef1e88055f8d82403e95434b36.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_35a94282dc6eb3b54382788717547c39.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_1d464b51f1c91f6c3bc8a42a87d6df74.jpg not downloaded yet
2026-04-27 08:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_c7985ec1eed521e1165bd1a648328d3f.jpg not downloaded yet
2026-04-27 08:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK88134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX40237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ21667> (referer: https://www.auto1.com/v1/car-details-view/LZ21667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-04-27 08:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792326b9-7eff-5dea-8690-079ff99ccbd0 with scrape type 1
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_1617ef0760ee3d01c046eb661ac7047a.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_182a033054b44f62abacc5f3026df138.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_faf7b4e0c26080a69e95c70857d0fdc2.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_06c61890fe573b32a0f5ef4517a003ae.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_42700058b4d690405cf7eec4c095f801.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_88833d69e9074f9d4daba8e2520705ee.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b89812854530dae5b6f6f54e43115d6c.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_6bab7047366d08cf2f1851f3cb821b7b.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_a497e8a2c0588460ae5877a8a9e0b9ea.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b0756a89469f6821bd0a63250ed3b674.jpg not downloaded yet
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF13899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b0756a89469f6821bd0a63250ed3b674.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c35150>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b0756a89469f6821bd0a63250ed3b674.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV13956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_a497e8a2c0588460ae5877a8a9e0b9ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c0fa50>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_a497e8a2c0588460ae5877a8a9e0b9ea.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_6bab7047366d08cf2f1851f3cb821b7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca0d10>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_6bab7047366d08cf2f1851f3cb821b7b.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX12342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU56840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_88833d69e9074f9d4daba8e2520705ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b89812854530dae5b6f6f54e43115d6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e17510>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_88833d69e9074f9d4daba8e2520705ee.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e16dd0>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b89812854530dae5b6f6f54e43115d6c.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK59952> (referer: https://www.auto1.com/v1/car-details-view/XK59952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-04-27 08:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97914618-b82d-5b17-a2c8-ab9e0601ce39 with scrape type 1
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg not downloaded yet
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_42700058b4d690405cf7eec4c095f801.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg not downloaded yet
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14810>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_42700058b4d690405cf7eec4c095f801.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eceb90>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f76050>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30195810>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301aad10>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecc310>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0310>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30090c90>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d510>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f77b10>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f75ed0>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97914618-b82d-5b17-a2c8-ab9e0601ce39, skipping ID generation
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97914618-b82d-5b17-a2c8-ab9e0601ce39 with scrape type 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97914618-b82d-5b17-a2c8-ab9e0601ce39 sending to next pipeline
2026-04-27 08:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97914618-b82d-5b17-a2c8-ab9e0601ce39, identifier: XK59952
2026-04-27 08:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-04-27 08:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-04-27 08:10:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952 to the API
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'city': 'Überherrn',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-04-28T15:47:26Z',
 'fuel_type': 'diesel',
 'id': '97914618-b82d-5b17-a2c8-ab9e0601ce39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2419,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK59952',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'location_confidence': 'geocoded',
 'longitude': 6.6984,
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 187503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg',
             'Width': 800}],
 'postal_code': '66802',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2016-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2016}
2026-04-27 08:10:26 [auto1.de] INFO: Saving data for XK59952: {'created_time': 1777277426.953502, 'last_price_update_time': 1777277426.953511, 'has_photos': True, 'auction_closing_time': 1777391246.0}
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_06c61890fe573b32a0f5ef4517a003ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a79590>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_06c61890fe573b32a0f5ef4517a003ae.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_faf7b4e0c26080a69e95c70857d0fdc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f3890>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_faf7b4e0c26080a69e95c70857d0fdc2.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_182a033054b44f62abacc5f3026df138.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_1617ef0760ee3d01c046eb661ac7047a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da0ad0>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_182a033054b44f62abacc5f3026df138.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3ad0>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_1617ef0760ee3d01c046eb661ac7047a.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 792326b9-7eff-5dea-8690-079ff99ccbd0
2026-04-27 08:10:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 792326b9-7eff-5dea-8690-079ff99ccbd0, skipping ID generation
2026-04-27 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792326b9-7eff-5dea-8690-079ff99ccbd0 with scrape type 1
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 792326b9-7eff-5dea-8690-079ff99ccbd0 sending to next pipeline
2026-04-27 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 792326b9-7eff-5dea-8690-079ff99ccbd0, identifier: LZ21667
2026-04-27 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-04-27 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-04-27 08:10:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667 to the API
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_1617ef0760ee3d01c046eb661ac7047a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'city': 'Kerpen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:02:04Z',
 'fuel_type': 'diesel',
 'id': '792326b9-7eff-5dea-8690-079ff99ccbd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ21667',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 98887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_1617ef0760ee3d01c046eb661ac7047a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_182a033054b44f62abacc5f3026df138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_faf7b4e0c26080a69e95c70857d0fdc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_06c61890fe573b32a0f5ef4517a003ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_42700058b4d690405cf7eec4c095f801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_88833d69e9074f9d4daba8e2520705ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b89812854530dae5b6f6f54e43115d6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_6bab7047366d08cf2f1851f3cb821b7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_a497e8a2c0588460ae5877a8a9e0b9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_792326b9-7eff-5dea-8690-079ff99ccbd0/792326b9-7eff-5dea-8690-079ff99ccbd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/aa/b0aa6da94fd54e8802fc7d39aafce3e8/pa/LZ21667_b0756a89469f6821bd0a63250ed3b674.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Dokker 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-04-27 08:10:28 [auto1.de] INFO: Saving data for LZ21667: {'created_time': 1777277428.053326, 'last_price_update_time': 1777277428.053338, 'has_photos': True, 'auction_closing_time': 1777388524.0}
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_c7985ec1eed521e1165bd1a648328d3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_1d464b51f1c91f6c3bc8a42a87d6df74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK76037> (referer: https://www.auto1.com/v1/car-details-view/PK76037/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e14990>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_c7985ec1eed521e1165bd1a648328d3f.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_35a94282dc6eb3b54382788717547c39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5ab50>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_1d464b51f1c91f6c3bc8a42a87d6df74.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75701526-2549-5e29-97dd-f2ee76aa604d with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_66d995c9957f5150bbf334c6272030e0.jpg not downloaded yet
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_68c913ed14038761e8a873df765ba6b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_fcf30eabee1f1bf5d1793b262d1a25fc.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_765c71eb0b75dc5b63ec827f22723cd6.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_7c1ed553ad244a6b79494f928ec9c39e.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_f6fae5ded01128ad1ce796ede8152151.jpg not downloaded yet
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebbc90>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_35a94282dc6eb3b54382788717547c39.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_66d995c9957f5150bbf334c6272030e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_fee2b0ef1e88055f8d82403e95434b36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f698d0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_68c913ed14038761e8a873df765ba6b8.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_7c1ed553ad244a6b79494f928ec9c39e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004cb10>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_66d995c9957f5150bbf334c6272030e0.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_765c71eb0b75dc5b63ec827f22723cd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca3290>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_fee2b0ef1e88055f8d82403e95434b36.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccb5350a-8276-59c1-b328-a1679a181ac8
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccb5350a-8276-59c1-b328-a1679a181ac8, skipping ID generation
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccb5350a-8276-59c1-b328-a1679a181ac8 sending to next pipeline
2026-04-27 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccb5350a-8276-59c1-b328-a1679a181ac8, identifier: JY20186
2026-04-27 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-04-27 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-04-27 08:10:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186 to the API
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_fee2b0ef1e88055f8d82403e95434b36.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'city': 'Kerpen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 2',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:56:58Z',
 'fuel_type': 'petrol',
 'id': 'ccb5350a-8276-59c1-b328-a1679a181ac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20186',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'MG Rover',
 'model': 'MGF',
 'odometer': 90591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_68c913ed14038761e8a873df765ba6b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_fee2b0ef1e88055f8d82403e95434b36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_35a94282dc6eb3b54382788717547c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_1d464b51f1c91f6c3bc8a42a87d6df74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ccb5350a-8276-59c1-b328-a1679a181ac8/ccb5350a-8276-59c1-b328-a1679a181ac8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/a7/cda756a058d79535be07ab52cb7e44ed/pa/JY20186_c7985ec1eed521e1165bd1a648328d3f.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2000-11-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MG Rover MGF 1.8 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2000}
2026-04-27 08:10:29 [auto1.de] INFO: Saving data for JY20186: {'created_time': 1777277429.218573, 'last_price_update_time': 1777277429.218625, 'has_photos': True, 'auction_closing_time': 1777391818.0}
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_f6fae5ded01128ad1ce796ede8152151.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b834d0>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_7c1ed553ad244a6b79494f928ec9c39e.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d83790>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_765c71eb0b75dc5b63ec827f22723cd6.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_fcf30eabee1f1bf5d1793b262d1a25fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011c710>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_f6fae5ded01128ad1ce796ede8152151.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ebe50>
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_fcf30eabee1f1bf5d1793b262d1a25fc.jpg saved to cache
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75701526-2549-5e29-97dd-f2ee76aa604d
2026-04-27 08:10:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75701526-2549-5e29-97dd-f2ee76aa604d, skipping ID generation
2026-04-27 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75701526-2549-5e29-97dd-f2ee76aa604d with scrape type 1
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75701526-2549-5e29-97dd-f2ee76aa604d sending to next pipeline
2026-04-27 08:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75701526-2549-5e29-97dd-f2ee76aa604d, identifier: PK76037
2026-04-27 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-04-27 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-04-27 08:10:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037 to the API
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_fcf30eabee1f1bf5d1793b262d1a25fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Karlskron',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:57:18Z',
 'fuel_type': 'petrol',
 'id': '75701526-2549-5e29-97dd-f2ee76aa604d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK76037',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 48600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_66d995c9957f5150bbf334c6272030e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_fcf30eabee1f1bf5d1793b262d1a25fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_765c71eb0b75dc5b63ec827f22723cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_7c1ed553ad244a6b79494f928ec9c39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75701526-2549-5e29-97dd-f2ee76aa604d/75701526-2549-5e29-97dd-f2ee76aa604d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75a5cbe22952c4d8213ca7868bc788/pa/PK76037_f6fae5ded01128ad1ce796ede8152151.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2010-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-04-27 08:10:30 [auto1.de] INFO: Saving data for PK76037: {'created_time': 1777277430.073937, 'last_price_update_time': 1777277430.073949, 'has_photos': True, 'auction_closing_time': 1777391838.0}
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66ed0>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22c34d50>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 10671 | hits on page: 40
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f09510>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: LZ21667
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: XK59952
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for XK59952: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: JY20186
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for JY20186: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: CY77324
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: BV23650
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for BV23650: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: XR64222
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: MM98410
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for MM98410: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: HF53882
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0a650>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY77324> (referer: https://www.auto1.com/v1/car-details-view/CY77324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: XF94363
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for XF94363: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: UT28734
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for UT28734: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: GH81329
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for GH81329: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: NJ21212
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for NJ21212: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: PA49455
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for PA49455: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: CN91045
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for CN91045: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: YN89321
2026-04-27 08:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd4810>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-04-27 08:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ee2a469-befa-5607-b315-aebe1f19de9f, skipping ID generation
2026-04-27 08:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee2a469-befa-5607-b315-aebe1f19de9f with scrape type 1
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ee2a469-befa-5607-b315-aebe1f19de9f sending to next pipeline
2026-04-27 08:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ee2a469-befa-5607-b315-aebe1f19de9f, identifier: AK26500
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d4490>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: YH32821
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for YH32821: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: FT05667
2026-04-27 08:10:30 [auto1.de] INFO: Scrape type for FT05667: 0
2026-04-27 08:10:30 [auto1.de] INFO: Found listing with ID: GJ97454
2026-04-27 08:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-04-27 08:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-04-27 08:10:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500 to the API
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'city': 'Seddiner See',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:40:10Z',
 'fuel_type': 'diesel',
 'id': '1ee2a469-befa-5607-b315-aebe1f19de9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK26500',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-04-27 08:10:31 [auto1.de] INFO: Saving data for AK26500: {'created_time': 1777277431.556422, 'last_price_update_time': 1777277431.556431, 'has_photos': True, 'auction_closing_time': 1777390810.0}
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: PG96754
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for PG96754: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: HR12459
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for HR12459: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: AN09987
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for AN09987: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: YS84502
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for YS84502: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: DV03966
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301aa290>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-04-27 08:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3a20c4-4892-53c7-9a01-26342a24560a with scrape type 1
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg not downloaded yet
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK88134> (referer: https://www.auto1.com/v1/car-details-view/VK88134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: SH94739
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for SH94739: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: KP66478
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for KP66478: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: UP81002
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for UP81002: 0
2026-04-27 08:10:31 [auto1.de] INFO: Found listing with ID: RT30217
2026-04-27 08:10:31 [auto1.de] INFO: Scrape type for RT30217: 1
2026-04-27 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg not downloaded yet
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5c910>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a23f10>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: LD23223
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for LD23223: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: UK68115
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for UK68115: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4996d246-59a5-5065-b908-c91ece24429e with identifier: VK88134
2026-04-27 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4996d246-59a5-5065-b908-c91ece24429e with scrape type 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_cd0f37b35f890e873179dcbb1a0abd65.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: XC77974
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for XC77974: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_2723dd033b4f77b383d08d9c2c674719.jpg not downloaded yet
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: XH85131
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for XH85131: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_9d18fbfac25bd80df7776f76b0bca288.jpg not downloaded yet
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: RR38517
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for RR38517: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eccb50>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fcd510>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3210f850>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_888dc42773c32c9e78705ae9a0a62669.jpg not downloaded yet
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: HG43188
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for HG43188: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a893d0>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_cd0f37b35f890e873179dcbb1a0abd65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b2a2511c12875d578796453088fb5d7e.jpg not downloaded yet
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: ZE64138
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for ZE64138: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_04d14eab91a7fb275a101338bfa6bcbf.jpg not downloaded yet
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: ND10633
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for ND10633: 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg not downloaded yet
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_116f46aa870ceaa3bb47603972cf599f.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004b990>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b806d0>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: KZ71563
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for KZ71563: 1
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_888dc42773c32c9e78705ae9a0a62669.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b60fc4291a828bbba01672edbafe3a96.jpg not downloaded yet
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: GT58505
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for GT58505: 1
2026-04-27 08:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_f2a880e6a4f2fc18907304c7ed28fa51.jpg not downloaded yet
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1e210>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_cd0f37b35f890e873179dcbb1a0abd65.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:32 [auto1.de] INFO: Found listing with ID: PV12364
2026-04-27 08:10:32 [auto1.de] INFO: Scrape type for PV12364: 1
2026-04-27 08:10:32 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_c79e854cb8f41d270ca50750b03ec552.jpg not downloaded yet
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_116f46aa870ceaa3bb47603972cf599f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS72141> (referer: https://www.auto1.com/v1/car-details-view/LS72141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1f010>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_888dc42773c32c9e78705ae9a0a62669.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003a350>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b60fc4291a828bbba01672edbafe3a96.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae4f10>
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_116f46aa870ceaa3bb47603972cf599f.jpg saved to cache
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-04-27 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with scrape type 1
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_d179fab8899aac08b526d5404ee82f97.jpg not downloaded yet
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_f2a880e6a4f2fc18907304c7ed28fa51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e6a4238e6583a43809619c5830d0055c.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2e022a3123e3b7add561ceeae07eaddd.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2bc160b711d312d722d9b37ee4ea9940.jpg not downloaded yet
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e096778839ffd6239ba67bc885fe6050.jpg not downloaded yet
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30194250>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b60fc4291a828bbba01672edbafe3a96.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_48dfc61eb0ca1faa3520971b192a5a85.jpg not downloaded yet
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_c79e854cb8f41d270ca50750b03ec552.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003a510>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_f2a880e6a4f2fc18907304c7ed28fa51.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_d179fab8899aac08b526d5404ee82f97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66950>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_c79e854cb8f41d270ca50750b03ec552.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7b290>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_d179fab8899aac08b526d5404ee82f97.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e096778839ffd6239ba67bc885fe6050.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_48dfc61eb0ca1faa3520971b192a5a85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffb4d0>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e096778839ffd6239ba67bc885fe6050.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8f5d0>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_48dfc61eb0ca1faa3520971b192a5a85.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2bc160b711d312d722d9b37ee4ea9940.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2e022a3123e3b7add561ceeae07eaddd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a571d0>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2bc160b711d312d722d9b37ee4ea9940.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bc4d0>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2e022a3123e3b7add561ceeae07eaddd.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e6a4238e6583a43809619c5830d0055c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300428d0>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e6a4238e6583a43809619c5830d0055c.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca
2026-04-27 08:10:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca, skipping ID generation
2026-04-27 08:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with scrape type 1
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca sending to next pipeline
2026-04-27 08:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca, identifier: LS72141
2026-04-27 08:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-04-27 08:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-04-27 08:10:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141 to the API
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e6a4238e6583a43809619c5830d0055c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'city': 'Ketzin',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:20:50Z',
 'fuel_type': 'petrol',
 'id': 'd3a1bcc7-b2de-51c1-aeb3-55e14af64fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS72141',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 103523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_d179fab8899aac08b526d5404ee82f97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e6a4238e6583a43809619c5830d0055c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2e022a3123e3b7add561ceeae07eaddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_2bc160b711d312d722d9b37ee4ea9940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_e096778839ffd6239ba67bc885fe6050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3a1bcc7-b2de-51c1-aeb3-55e14af64fca/d3a1bcc7-b2de-51c1-aeb3-55e14af64fca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ba/ceba010cc1ecc64f2a0424ffcc791c68/pa/LS72141_48dfc61eb0ca1faa3520971b192a5a85.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2009-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2009}
2026-04-27 08:10:35 [auto1.de] INFO: Saving data for LS72141: {'created_time': 1777277435.640312, 'last_price_update_time': 1777277435.640334, 'has_photos': True, 'auction_closing_time': 1777389650.0}
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX40237> (referer: https://www.auto1.com/v1/car-details-view/CX40237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028d710>
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg saved to cache
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-04-27 08:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620172ed-a24a-5791-bec1-5b94cd171209 with scrape type 1
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_3f15927e0e2a18e2f653d1300de56849.jpg not downloaded yet
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_d704ff4f54b81d254d0a5db9976845c3.jpg not downloaded yet
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_4303d6cb67815066c9b4e6a05caa764c.jpg not downloaded yet
2026-04-27 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_321815b505c08bba63f920eef2b9fc3d.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2e6704b3fed08359e32c52c77550863d.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2ec57c0882e48ded488b5fac6d65dcf6.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_6820ee6f01138b934ae1f229eae8980e.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_a0d5f87915a74851a74f3b22ab853b1f.jpg not downloaded yet
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_04d14eab91a7fb275a101338bfa6bcbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_7c9e6f0ab83f6063e2ddf90ad990ac28.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_0df9299cc88269ddddcf418b5ddd4210.jpg not downloaded yet
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff8090>
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_04d14eab91a7fb275a101338bfa6bcbf.jpg saved to cache
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_a0d5f87915a74851a74f3b22ab853b1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d3ed0>
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_a0d5f87915a74851a74f3b22ab853b1f.jpg saved to cache
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_0df9299cc88269ddddcf418b5ddd4210.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077250>
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_0df9299cc88269ddddcf418b5ddd4210.jpg saved to cache
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_7c9e6f0ab83f6063e2ddf90ad990ac28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7ad410>
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_7c9e6f0ab83f6063e2ddf90ad990ac28.jpg saved to cache
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_6820ee6f01138b934ae1f229eae8980e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU56840> (referer: https://www.auto1.com/v1/car-details-view/DU56840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30077090>
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_6820ee6f01138b934ae1f229eae8980e.jpg saved to cache
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2ec57c0882e48ded488b5fac6d65dcf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-04-27 08:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d855a0-5ebb-55a0-b360-025ca21c840f with scrape type 1
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg not downloaded yet
2026-04-27 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg not downloaded yet
2026-04-27 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2e6704b3fed08359e32c52c77550863d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg not downloaded yet
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_321815b505c08bba63f920eef2b9fc3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0bf50>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2ec57c0882e48ded488b5fac6d65dcf6.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f379d0>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2e6704b3fed08359e32c52c77550863d.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f1250>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_321815b505c08bba63f920eef2b9fc3d.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bda50>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1e90>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab3590>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01890>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebb1310>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-04-27 08:10:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5d855a0-5ebb-55a0-b360-025ca21c840f, skipping ID generation
2026-04-27 08:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d855a0-5ebb-55a0-b360-025ca21c840f with scrape type 1
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5d855a0-5ebb-55a0-b360-025ca21c840f sending to next pipeline
2026-04-27 08:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5d855a0-5ebb-55a0-b360-025ca21c840f, identifier: DU56840
2026-04-27 08:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-04-27 08:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-04-27 08:10:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840 to the API
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'city': 'Hattingen',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-04-28T15:55:04Z',
 'fuel_type': 'petrol',
 'id': 'd5d855a0-5ebb-55a0-b360-025ca21c840f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.3954,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU56840',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'location_confidence': 'geocoded',
 'longitude': 7.1779,
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 80663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg',
             'Width': 800}],
 'postal_code': '45525',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2009-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-04-27 08:10:38 [auto1.de] INFO: Saving data for DU56840: {'created_time': 1777277438.210136, 'last_price_update_time': 1777277438.210146, 'has_photos': True, 'auction_closing_time': 1777391704.0}
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_d704ff4f54b81d254d0a5db9976845c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_4303d6cb67815066c9b4e6a05caa764c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_3f15927e0e2a18e2f653d1300de56849.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a790>
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_d704ff4f54b81d254d0a5db9976845c3.jpg saved to cache
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67010>
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_4303d6cb67815066c9b4e6a05caa764c.jpg saved to cache
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64cd0>
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_3f15927e0e2a18e2f653d1300de56849.jpg saved to cache
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 620172ed-a24a-5791-bec1-5b94cd171209
2026-04-27 08:10:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 620172ed-a24a-5791-bec1-5b94cd171209, skipping ID generation
2026-04-27 08:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620172ed-a24a-5791-bec1-5b94cd171209 with scrape type 1
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 620172ed-a24a-5791-bec1-5b94cd171209 sending to next pipeline
2026-04-27 08:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 620172ed-a24a-5791-bec1-5b94cd171209, identifier: CX40237
2026-04-27 08:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-04-27 08:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-04-27 08:10:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237 to the API
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_3f15927e0e2a18e2f653d1300de56849.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'city': 'Buch',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:11:06Z',
 'fuel_type': 'petrol',
 'id': '620172ed-a24a-5791-bec1-5b94cd171209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX40237',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 89178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_3f15927e0e2a18e2f653d1300de56849.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_d704ff4f54b81d254d0a5db9976845c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_4303d6cb67815066c9b4e6a05caa764c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_321815b505c08bba63f920eef2b9fc3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2e6704b3fed08359e32c52c77550863d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_2ec57c0882e48ded488b5fac6d65dcf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_6820ee6f01138b934ae1f229eae8980e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_a0d5f87915a74851a74f3b22ab853b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_7c9e6f0ab83f6063e2ddf90ad990ac28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_620172ed-a24a-5791-bec1-5b94cd171209/620172ed-a24a-5791-bec1-5b94cd171209_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/9e/da9e50c6803e34256ff16f9293b05008/pa/CX40237_0df9299cc88269ddddcf418b5ddd4210.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2018}
2026-04-27 08:10:38 [auto1.de] INFO: Saving data for CX40237: {'created_time': 1777277438.909695, 'last_price_update_time': 1777277438.909705, 'has_photos': True, 'auction_closing_time': 1777389066.0}
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b2a2511c12875d578796453088fb5d7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91550>
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg saved to cache
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2990>
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b2a2511c12875d578796453088fb5d7e.jpg saved to cache
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ddf10>
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg saved to cache
2026-04-27 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:43 [scrapy.extensions.logstats] INFO: Crawled 665 pages (at 23 pages/min), scraped 296 items (at 10 items/min)
2026-04-27 08:10:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:10:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.605(s), this was the 1st time calling it.
2026-04-27 08:10:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.3087655047060425 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV13956> (referer: https://www.auto1.com/v1/car-details-view/HV13956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_9d18fbfac25bd80df7776f76b0bca288.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with identifier: HV13956
2026-04-27 08:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with scrape type 1
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_2ccad5e9e60996a81488b7ce2b2685f4.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_e262bb352b91d5ce903450fc37f6f5f2.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_683181d8a4595271be2c443b7e4d12f6.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d4b534bfe97e5d00cba511814578db10.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cda182fd835eb6be95f72a608ad623dd.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cf35d890bdc2d8ba3a3f528dfdaa5b00.jpg not downloaded yet
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3010>
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_9d18fbfac25bd80df7776f76b0bca288.jpg saved to cache
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d694639169c36d7aeb1870959a0038d3.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_eef62395d34780815149c64bacb1e988.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_895e71e8f3f098388cccf2d6ebc14ea3.jpg not downloaded yet
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_6b20f376f6fc431cbd0845ff80b63642.jpg not downloaded yet
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_6b20f376f6fc431cbd0845ff80b63642.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1910>
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg saved to cache
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_895e71e8f3f098388cccf2d6ebc14ea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ddd50>
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_6b20f376f6fc431cbd0845ff80b63642.jpg saved to cache
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_eef62395d34780815149c64bacb1e988.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1e110>
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_895e71e8f3f098388cccf2d6ebc14ea3.jpg saved to cache
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d694639169c36d7aeb1870959a0038d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee5e90>
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_eef62395d34780815149c64bacb1e988.jpg saved to cache
2026-04-27 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cf35d890bdc2d8ba3a3f528dfdaa5b00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1c10>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d694639169c36d7aeb1870959a0038d3.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cda182fd835eb6be95f72a608ad623dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64dd0>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cf35d890bdc2d8ba3a3f528dfdaa5b00.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d4b534bfe97e5d00cba511814578db10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a5be50>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cda182fd835eb6be95f72a608ad623dd.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_683181d8a4595271be2c443b7e4d12f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2ac10>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d4b534bfe97e5d00cba511814578db10.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_e262bb352b91d5ce903450fc37f6f5f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64fd0>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_683181d8a4595271be2c443b7e4d12f6.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_2ccad5e9e60996a81488b7ce2b2685f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0c1d0>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_e262bb352b91d5ce903450fc37f6f5f2.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1a10>
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_2ccad5e9e60996a81488b7ce2b2685f4.jpg saved to cache
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5
2026-04-27 08:10:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5, skipping ID generation
2026-04-27 08:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with scrape type 1
2026-04-27 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 sending to next pipeline
2026-04-27 08:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5, identifier: HV13956
2026-04-27 08:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with identifier: HV13956
2026-04-27 08:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with identifier: HV13956
2026-04-27 08:10:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ba95af6-085d-51e6-b8f3-3c21525dbbf5 with identifier: HV13956 to the API
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_2ccad5e9e60996a81488b7ce2b2685f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Kandel',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-04-28T15:30:07Z',
 'fuel_type': 'diesel',
 'id': '8ba95af6-085d-51e6-b8f3-3c21525dbbf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0828,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV13956',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'location_confidence': 'geocoded',
 'longitude': 8.1972,
 'make': 'BMW',
 'model': '7er',
 'odometer': 206498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_2ccad5e9e60996a81488b7ce2b2685f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_e262bb352b91d5ce903450fc37f6f5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_683181d8a4595271be2c443b7e4d12f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d4b534bfe97e5d00cba511814578db10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cda182fd835eb6be95f72a608ad623dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_cf35d890bdc2d8ba3a3f528dfdaa5b00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_d694639169c36d7aeb1870959a0038d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_eef62395d34780815149c64bacb1e988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_895e71e8f3f098388cccf2d6ebc14ea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ba95af6-085d-51e6-b8f3-3c21525dbbf5/8ba95af6-085d-51e6-b8f3-3c21525dbbf5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/90/cd903e220f7c7114a4b87c1eb1d78d6d/pa/HV13956_6b20f376f6fc431cbd0845ff80b63642.jpg',
             'Width': 800}],
 'postal_code': '76870',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 730d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-04-27 08:10:51 [auto1.de] INFO: Saving data for HV13956: {'created_time': 1777277451.97065, 'last_price_update_time': 1777277451.970669, 'has_photos': True, 'auction_closing_time': 1777390207.0}
2026-04-27 08:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV03966> (referer: https://www.auto1.com/v1/car-details-view/DV03966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_2723dd033b4f77b383d08d9c2c674719.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1122f1-2a58-5c6d-8340-323c739a78e4 with identifier: DV03966
2026-04-27 08:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1122f1-2a58-5c6d-8340-323c739a78e4 with scrape type 1
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_d835e057d814d95de7fc05646f162bd3.jpg not downloaded yet
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_cdecd567a76c0e36346b95b4514e530a.jpg not downloaded yet
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1ce5e2e64e1f0a549a168d186db376d1.jpg not downloaded yet
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_8705532f50a555968fd43532a5990668.jpg not downloaded yet
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1d5e835d1e2fe82add3c0954d85e81dc.jpg not downloaded yet
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2710>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_2723dd033b4f77b383d08d9c2c674719.jpg saved to cache
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4996d246-59a5-5065-b908-c91ece24429e
2026-04-27 08:11:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4996d246-59a5-5065-b908-c91ece24429e, skipping ID generation
2026-04-27 08:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4996d246-59a5-5065-b908-c91ece24429e with scrape type 1
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4996d246-59a5-5065-b908-c91ece24429e sending to next pipeline
2026-04-27 08:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4996d246-59a5-5065-b908-c91ece24429e, identifier: VK88134
2026-04-27 08:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4996d246-59a5-5065-b908-c91ece24429e with identifier: VK88134
2026-04-27 08:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4996d246-59a5-5065-b908-c91ece24429e with identifier: VK88134
2026-04-27 08:11:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4996d246-59a5-5065-b908-c91ece24429e with identifier: VK88134 to the API
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_2723dd033b4f77b383d08d9c2c674719.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:09:48Z',
 'fuel_type': 'diesel',
 'id': '4996d246-59a5-5065-b908-c91ece24429e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK88134',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 245417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_cd0f37b35f890e873179dcbb1a0abd65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_2723dd033b4f77b383d08d9c2c674719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_9d18fbfac25bd80df7776f76b0bca288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_888dc42773c32c9e78705ae9a0a62669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b2a2511c12875d578796453088fb5d7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_04d14eab91a7fb275a101338bfa6bcbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_116f46aa870ceaa3bb47603972cf599f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_b60fc4291a828bbba01672edbafe3a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_f2a880e6a4f2fc18907304c7ed28fa51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4996d246-59a5-5065-b908-c91ece24429e/4996d246-59a5-5065-b908-c91ece24429e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/a0/2da0a82389375124ca1af0c140b94415/pa/VK88134_c79e854cb8f41d270ca50750b03ec552.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2016-11-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline 4Motion',
 'transmission': 'automatic',
 'trim': 'Trendline 4Motion',
 'year': 2016}
2026-04-27 08:11:02 [auto1.de] INFO: Saving data for VK88134: {'created_time': 1777277462.460315, 'last_price_update_time': 1777277462.460328, 'has_photos': True, 'auction_closing_time': 1777388988.0}
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1d5e835d1e2fe82add3c0954d85e81dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad310>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg saved to cache
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04510>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1d5e835d1e2fe82add3c0954d85e81dc.jpg saved to cache
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.472(s), this was the 1st time calling it.
2026-04-27 08:11:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.032095404440323 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_8705532f50a555968fd43532a5990668.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1ce5e2e64e1f0a549a168d186db376d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae6350>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_8705532f50a555968fd43532a5990668.jpg saved to cache
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_cdecd567a76c0e36346b95b4514e530a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b66350>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1ce5e2e64e1f0a549a168d186db376d1.jpg saved to cache
2026-04-27 08:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_d835e057d814d95de7fc05646f162bd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb3b50>
2026-04-27 08:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_cdecd567a76c0e36346b95b4514e530a.jpg saved to cache
2026-04-27 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f0b90>
2026-04-27 08:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_d835e057d814d95de7fc05646f162bd3.jpg saved to cache
2026-04-27 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b1122f1-2a58-5c6d-8340-323c739a78e4
2026-04-27 08:11:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b1122f1-2a58-5c6d-8340-323c739a78e4, skipping ID generation
2026-04-27 08:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1122f1-2a58-5c6d-8340-323c739a78e4 with scrape type 1
2026-04-27 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b1122f1-2a58-5c6d-8340-323c739a78e4 sending to next pipeline
2026-04-27 08:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b1122f1-2a58-5c6d-8340-323c739a78e4, identifier: DV03966
2026-04-27 08:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b1122f1-2a58-5c6d-8340-323c739a78e4 with identifier: DV03966
2026-04-27 08:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b1122f1-2a58-5c6d-8340-323c739a78e4 with identifier: DV03966
2026-04-27 08:11:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b1122f1-2a58-5c6d-8340-323c739a78e4 with identifier: DV03966 to the API
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_d835e057d814d95de7fc05646f162bd3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'city': 'Schweitenkirchen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:15:35Z',
 'fuel_type': 'petrol',
 'id': '9b1122f1-2a58-5c6d-8340-323c739a78e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.5033,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV03966',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'location_confidence': 'geocoded',
 'longitude': 11.6045,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 123632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_d835e057d814d95de7fc05646f162bd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_cdecd567a76c0e36346b95b4514e530a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1ce5e2e64e1f0a549a168d186db376d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_8705532f50a555968fd43532a5990668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b1122f1-2a58-5c6d-8340-323c739a78e4/9b1122f1-2a58-5c6d-8340-323c739a78e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/53/e0532dc8ca869020d5f1b7d36fcc3abc/pa/DV03966_1d5e835d1e2fe82add3c0954d85e81dc.jpg',
             'Width': 800}],
 'postal_code': '85301',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2007-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2007}
2026-04-27 08:11:03 [auto1.de] INFO: Saving data for DV03966: {'created_time': 1777277463.80185, 'last_price_update_time': 1777277463.801861, 'has_photos': True, 'auction_closing_time': 1777389335.0}
2026-04-27 08:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.244(s), this was the 1st time calling it.
2026-04-27 08:11:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.837359739063223 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.844(s), this was the 1st time calling it.
2026-04-27 08:11:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7722276041461473 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN89321> (referer: https://www.auto1.com/v1/car-details-view/YN89321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bbb0249-e6ca-534c-8b7f-65b577afc770 with identifier: YN89321
2026-04-27 08:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbb0249-e6ca-534c-8b7f-65b577afc770 with scrape type 1
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_74c9a55bbd4dc05c804f218ee7c65f33.jpg not downloaded yet
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_3809136708aba03816e7871958c9fbed.jpg not downloaded yet
2026-04-27 08:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_b00212925fd59fa46d1ca9c09094a95f.jpg not downloaded yet
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_aee66852609a9d429bee72ec85bc40ab.jpg not downloaded yet
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_f008ab9f99907e5fd2032af5307598c2.jpg not downloaded yet
2026-04-27 08:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8dc10>
2026-04-27 08:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg saved to cache
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-04-27 08:11:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c3a20c4-4892-53c7-9a01-26342a24560a, skipping ID generation
2026-04-27 08:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3a20c4-4892-53c7-9a01-26342a24560a with scrape type 1
2026-04-27 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c3a20c4-4892-53c7-9a01-26342a24560a sending to next pipeline
2026-04-27 08:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3a20c4-4892-53c7-9a01-26342a24560a, identifier: CY77324
2026-04-27 08:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-04-27 08:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-04-27 08:11:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324 to the API
2026-04-27 08:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'city': 'Schweitenkirchen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-04-28T15:17:34Z',
 'fuel_type': 'petrol',
 'id': '2c3a20c4-4892-53c7-9a01-26342a24560a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.5033,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY77324',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'location_confidence': 'geocoded',
 'longitude': 11.6045,
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 60903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46556,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49356,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44344,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33798,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44938,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54052,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36029,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41841,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47168,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46912,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg',
             'Width': 640}],
 'postal_code': '85301',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-X Mild-Hybrid Selection 2WD',
 'transmission': 'automatic',
 'trim': 'Selection 2WD',
 'year': 2021}
2026-04-27 08:11:21 [auto1.de] INFO: Saving data for CY77324: {'created_time': 1777277481.236272, 'last_price_update_time': 1777277481.236284, 'has_photos': True, 'auction_closing_time': 1777389454.0}
2026-04-27 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_3809136708aba03816e7871958c9fbed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7a3d0>
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_3809136708aba03816e7871958c9fbed.jpg saved to cache
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_f008ab9f99907e5fd2032af5307598c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30057f10>
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_f008ab9f99907e5fd2032af5307598c2.jpg saved to cache
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_aee66852609a9d429bee72ec85bc40ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb2710>
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_aee66852609a9d429bee72ec85bc40ab.jpg saved to cache
2026-04-27 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_b00212925fd59fa46d1ca9c09094a95f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_74c9a55bbd4dc05c804f218ee7c65f33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1f150>
2026-04-27 08:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_b00212925fd59fa46d1ca9c09094a95f.jpg saved to cache
2026-04-27 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab0b90>
2026-04-27 08:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_74c9a55bbd4dc05c804f218ee7c65f33.jpg saved to cache
2026-04-27 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bbb0249-e6ca-534c-8b7f-65b577afc770
2026-04-27 08:11:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bbb0249-e6ca-534c-8b7f-65b577afc770, skipping ID generation
2026-04-27 08:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbb0249-e6ca-534c-8b7f-65b577afc770 with scrape type 1
2026-04-27 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bbb0249-e6ca-534c-8b7f-65b577afc770 sending to next pipeline
2026-04-27 08:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bbb0249-e6ca-534c-8b7f-65b577afc770, identifier: YN89321
2026-04-27 08:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bbb0249-e6ca-534c-8b7f-65b577afc770 with identifier: YN89321
2026-04-27 08:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bbb0249-e6ca-534c-8b7f-65b577afc770 with identifier: YN89321
2026-04-27 08:11:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bbb0249-e6ca-534c-8b7f-65b577afc770 with identifier: YN89321 to the API
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_74c9a55bbd4dc05c804f218ee7c65f33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'city': 'Hilden',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:28:47Z',
 'fuel_type': 'petrol',
 'id': '9bbb0249-e6ca-534c-8b7f-65b577afc770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.1694,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN89321',
 'listing': 'auction',
 'location': 'Hilden',
 'location_confidence': 'geocoded',
 'longitude': 6.9253,
 'make': 'Volkswagen',
 'model': 'Golf VI Plus',
 'odometer': 264074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_74c9a55bbd4dc05c804f218ee7c65f33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_3809136708aba03816e7871958c9fbed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_b00212925fd59fa46d1ca9c09094a95f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_aee66852609a9d429bee72ec85bc40ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9bbb0249-e6ca-534c-8b7f-65b577afc770/9bbb0249-e6ca-534c-8b7f-65b577afc770_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fa/cbfa2e3cbab1b9bbb7d790d45b7f6ae3/pa/YN89321_f008ab9f99907e5fd2032af5307598c2.jpg',
             'Width': 800}],
 'postal_code': '40721',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Düsseldorf',
 'province_code': 'DE-051',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2009-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI Plus 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-04-27 08:11:22 [auto1.de] INFO: Saving data for YN89321: {'created_time': 1777277482.5419, 'last_price_update_time': 1777277482.541912, 'has_photos': True, 'auction_closing_time': 1777390127.0}
2026-04-27 08:11:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF53882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.601(s), this was the 1st time calling it.
2026-04-27 08:11:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.986430028859091 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:43 [scrapy.extensions.logstats] INFO: Crawled 669 pages (at 4 pages/min), scraped 301 items (at 5 items/min)
2026-04-27 08:11:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR64222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR38517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ71563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND10633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT58505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE64138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH85131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK68115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD23223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG43188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF53882> (referer: https://www.auto1.com/v1/car-details-view/HF53882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-04-27 08:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694ab02c-2af8-5d79-a53c-4590e10a36dc with scrape type 1
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_ff0de64f2b091d36c8a75cce0f068f7a.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d43f2061f66fac7b138555d8dad57193.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d600e04c6cdcc40cf7fe92926d35dd50.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_3c6fc580fe7653c763295731c5c2bb7a.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d3605d06281cd2969507e4d0d65bf7ca.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_36a4da04226494ee7ee9f0e6108e5b8e.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_b142e14d2160285032491f620583568d.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_65171c25bd3caf1f4da20b93fc9ba249.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_c264dd327684799f9601ed2221bcf88d.jpg not downloaded yet
2026-04-27 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_72029f7895c1d00e788fdb148dccba4d.jpg not downloaded yet
2026-04-27 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT30217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_72029f7895c1d00e788fdb148dccba4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1f9d0>
2026-04-27 08:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_72029f7895c1d00e788fdb148dccba4d.jpg saved to cache
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR38517> (referer: https://www.auto1.com/v1/car-details-view/RR38517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with identifier: RR38517
2026-04-27 08:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with scrape type 1
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_ca4730ed1598749ae4b874ccf4dcb700.jpg not downloaded yet
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_d311934d33fc5c2f4ea2e15ba1c01171.jpg not downloaded yet
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_c20449391aedcaabbdbf11c4f654460e.jpg not downloaded yet
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_863ec968c281c7b1faa0add179d49eb6.jpg not downloaded yet
2026-04-27 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_93b9d1cfff1a6be572e9c85c5bd15c9f.jpg not downloaded yet
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_c264dd327684799f9601ed2221bcf88d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR64222> (referer: https://www.auto1.com/v1/car-details-view/XR64222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb26d0>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_c264dd327684799f9601ed2221bcf88d.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd08aca9-f026-54a7-bf9c-09e936922946 with identifier: XR64222
2026-04-27 08:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd08aca9-f026-54a7-bf9c-09e936922946 with scrape type 1
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_07841982a4604634d71f92180c0a3408.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_9c59109c2890cef5680f88f5bef88345.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_70d711e4a42f677c4a00866be7a96bb0.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_d902cbf1eb9ba30f821a4cdb6f55a736.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_cf041668150613d1e6b8cb6a7abeddd5.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_1050ad1e77f36b3a6b9d4f7258952757.jpg not downloaded yet
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_93b9d1cfff1a6be572e9c85c5bd15c9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_09e993a43c0d57f93c2ec66e052a4ee6.jpg not downloaded yet
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_863ec968c281c7b1faa0add179d49eb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_2ed78febb194306d291b044252dcb164.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_f680ed21b59efbde9fa779b16e3d8ed0.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_30f83a393374ce667010f70402377af2.jpg not downloaded yet
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f1050>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_93b9d1cfff1a6be572e9c85c5bd15c9f.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ71563> (referer: https://www.auto1.com/v1/car-details-view/KZ71563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8d810>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_863ec968c281c7b1faa0add179d49eb6.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_09e993a43c0d57f93c2ec66e052a4ee6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-04-27 08:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bce661a-2b68-5fac-8189-71a1f003fde7 with scrape type 1
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_ba3244725144728b08134f2e6ffd3542.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e1feca66b602a3bdef2f4678ea0b5c19.jpg not downloaded yet
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_1050ad1e77f36b3a6b9d4f7258952757.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5beb32bd3ca38effe269295862111dfe.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e8883e8b49ed39a8847361b93a99233b.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_c382b053913c1fc99a4dd223c6d281cb.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_7790d0bd8b3f3c1868ca76a3f26e51c7.jpg not downloaded yet
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b00f10>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_09e993a43c0d57f93c2ec66e052a4ee6.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_1a73503a94dce6fad03d18d3538264cf.jpg not downloaded yet
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_f680ed21b59efbde9fa779b16e3d8ed0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_8d5cd8d9550739af8886589cb39e3c71.jpg not downloaded yet
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_280e87b9ea471ba3c86147c485632320.jpg not downloaded yet
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b31790>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_1050ad1e77f36b3a6b9d4f7258952757.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e1feca66b602a3bdef2f4678ea0b5c19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5ab079b14f70aadf276162bc9b7decbc.jpg not downloaded yet
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d090>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_f680ed21b59efbde9fa779b16e3d8ed0.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_30f83a393374ce667010f70402377af2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab0250>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e1feca66b602a3bdef2f4678ea0b5c19.jpg saved to cache
2026-04-27 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_7790d0bd8b3f3c1868ca76a3f26e51c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efb390>
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_30f83a393374ce667010f70402377af2.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_280e87b9ea471ba3c86147c485632320.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30074dd0>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_7790d0bd8b3f3c1868ca76a3f26e51c7.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5ab079b14f70aadf276162bc9b7decbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_1a73503a94dce6fad03d18d3538264cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e3d0>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_280e87b9ea471ba3c86147c485632320.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_8d5cd8d9550739af8886589cb39e3c71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006f590>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5ab079b14f70aadf276162bc9b7decbc.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e8883e8b49ed39a8847361b93a99233b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04f90>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_1a73503a94dce6fad03d18d3538264cf.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006dfd0>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_8d5cd8d9550739af8886589cb39e3c71.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_c382b053913c1fc99a4dd223c6d281cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5beb32bd3ca38effe269295862111dfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_ba3244725144728b08134f2e6ffd3542.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cdbed0>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e8883e8b49ed39a8847361b93a99233b.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e550>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_c382b053913c1fc99a4dd223c6d281cb.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_2ed78febb194306d291b044252dcb164.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_d902cbf1eb9ba30f821a4cdb6f55a736.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ebb450>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5beb32bd3ca38effe269295862111dfe.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91a90>
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_ba3244725144728b08134f2e6ffd3542.jpg saved to cache
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bce661a-2b68-5fac-8189-71a1f003fde7
2026-04-27 08:12:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bce661a-2b68-5fac-8189-71a1f003fde7, skipping ID generation
2026-04-27 08:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bce661a-2b68-5fac-8189-71a1f003fde7 with scrape type 1
2026-04-27 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bce661a-2b68-5fac-8189-71a1f003fde7 sending to next pipeline
2026-04-27 08:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bce661a-2b68-5fac-8189-71a1f003fde7, identifier: KZ71563
2026-04-27 08:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-04-27 08:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-04-27 08:12:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563 to the API
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_ba3244725144728b08134f2e6ffd3542.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': 'Rental',
 'city': 'Dortmund',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:58:30Z',
 'fuel_type': 'diesel',
 'id': '8bce661a-2b68-5fac-8189-71a1f003fde7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ71563',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 122162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_ba3244725144728b08134f2e6ffd3542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e1feca66b602a3bdef2f4678ea0b5c19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5beb32bd3ca38effe269295862111dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_e8883e8b49ed39a8847361b93a99233b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_c382b053913c1fc99a4dd223c6d281cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_7790d0bd8b3f3c1868ca76a3f26e51c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_1a73503a94dce6fad03d18d3538264cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_8d5cd8d9550739af8886589cb39e3c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_280e87b9ea471ba3c86147c485632320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8bce661a-2b68-5fac-8189-71a1f003fde7/8bce661a-2b68-5fac-8189-71a1f003fde7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/ef/dfefdc88fa79d6d83e0872d5f9591daa/pa/KZ71563_5ab079b14f70aadf276162bc9b7decbc.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2017-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-04-27 08:12:14 [auto1.de] INFO: Saving data for KZ71563: {'created_time': 1777277534.229784, 'last_price_update_time': 1777277534.229795, 'has_photos': True, 'auction_closing_time': 1777391910.0}
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_cf041668150613d1e6b8cb6a7abeddd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE64138> (referer: https://www.auto1.com/v1/car-details-view/ZE64138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9d110>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_2ed78febb194306d291b044252dcb164.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b799d0>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_d902cbf1eb9ba30f821a4cdb6f55a736.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e92690>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_cf041668150613d1e6b8cb6a7abeddd5.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_07841982a4604634d71f92180c0a3408.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-04-27 08:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 1
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_5ef6aa72711f13bb1a0c2f3b732ed5f8.jpg not downloaded yet
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_70d711e4a42f677c4a00866be7a96bb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_16d936324418fefa0ec9af076fd191e2.jpg not downloaded yet
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_9c59109c2890cef5680f88f5bef88345.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3eece8c9caa8a3d9f7b50beeb541dd81.jpg not downloaded yet
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_2cb106dcd49941029d34b342a7558043.jpg not downloaded yet
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3253fdf1e946c5f4960ad6b179e1e494.jpg not downloaded yet
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_18e449c2408adc4057784e07367e16d2.jpg not downloaded yet
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042ed0>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_07841982a4604634d71f92180c0a3408.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_5ef6aa72711f13bb1a0c2f3b732ed5f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_6455cb4d65ab5889567bfb99907ce387.jpg not downloaded yet
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_835a13fb174d9ae56cb66294a5f9462f.jpg not downloaded yet
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_b52d551ad6d883e75539bf99cf8d3b69.jpg not downloaded yet
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ece550>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_70d711e4a42f677c4a00866be7a96bb0.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006d950>
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_9c59109c2890cef5680f88f5bef88345.jpg saved to cache
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd08aca9-f026-54a7-bf9c-09e936922946
2026-04-27 08:12:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd08aca9-f026-54a7-bf9c-09e936922946, skipping ID generation
2026-04-27 08:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd08aca9-f026-54a7-bf9c-09e936922946 with scrape type 1
2026-04-27 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd08aca9-f026-54a7-bf9c-09e936922946 sending to next pipeline
2026-04-27 08:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd08aca9-f026-54a7-bf9c-09e936922946, identifier: XR64222
2026-04-27 08:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd08aca9-f026-54a7-bf9c-09e936922946 with identifier: XR64222
2026-04-27 08:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd08aca9-f026-54a7-bf9c-09e936922946 with identifier: XR64222
2026-04-27 08:12:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd08aca9-f026-54a7-bf9c-09e936922946 with identifier: XR64222 to the API
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_9c59109c2890cef5680f88f5bef88345.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'category': None,
 'city': 'Kerpen',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:34:14Z',
 'fuel_type': 'diesel',
 'id': 'bd08aca9-f026-54a7-bf9c-09e936922946',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR64222',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 147279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_07841982a4604634d71f92180c0a3408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_9c59109c2890cef5680f88f5bef88345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_70d711e4a42f677c4a00866be7a96bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_d902cbf1eb9ba30f821a4cdb6f55a736.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_cf041668150613d1e6b8cb6a7abeddd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_1050ad1e77f36b3a6b9d4f7258952757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_09e993a43c0d57f93c2ec66e052a4ee6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_2ed78febb194306d291b044252dcb164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_f680ed21b59efbde9fa779b16e3d8ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bd08aca9-f026-54a7-bf9c-09e936922946/bd08aca9-f026-54a7-bf9c-09e936922946_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/80/cf808c42ece67f41b51b1d3161c50470/pa/XR64222_30f83a393374ce667010f70402377af2.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-11-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'automatic',
 'trim': 'Kasten FWD',
 'year': 2020}
2026-04-27 08:12:15 [auto1.de] INFO: Saving data for XR64222: {'created_time': 1777277535.09358, 'last_price_update_time': 1777277535.09359, 'has_photos': True, 'auction_closing_time': 1777390454.0}
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_d311934d33fc5c2f4ea2e15ba1c01171.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3df6730078d082b543201b0acb1c21fa.jpg not downloaded yet
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_16d936324418fefa0ec9af076fd191e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_c20449391aedcaabbdbf11c4f654460e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_18e449c2408adc4057784e07367e16d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7610>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_5ef6aa72711f13bb1a0c2f3b732ed5f8.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca1b90>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_d311934d33fc5c2f4ea2e15ba1c01171.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a13350>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_16d936324418fefa0ec9af076fd191e2.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eceb10>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_c20449391aedcaabbdbf11c4f654460e.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34a10>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_18e449c2408adc4057784e07367e16d2.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_b52d551ad6d883e75539bf99cf8d3b69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_6455cb4d65ab5889567bfb99907ce387.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3253fdf1e946c5f4960ad6b179e1e494.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_835a13fb174d9ae56cb66294a5f9462f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f04110>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_b52d551ad6d883e75539bf99cf8d3b69.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b85dd0>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_6455cb4d65ab5889567bfb99907ce387.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29b50>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3253fdf1e946c5f4960ad6b179e1e494.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f1090>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_835a13fb174d9ae56cb66294a5f9462f.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_2cb106dcd49941029d34b342a7558043.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3df6730078d082b543201b0acb1c21fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_ca4730ed1598749ae4b874ccf4dcb700.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3eece8c9caa8a3d9f7b50beeb541dd81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30042a10>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_2cb106dcd49941029d34b342a7558043.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_b142e14d2160285032491f620583568d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d3605d06281cd2969507e4d0d65bf7ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_36a4da04226494ee7ee9f0e6108e5b8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd6550>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3df6730078d082b543201b0acb1c21fa.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f47290>
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_ca4730ed1598749ae4b874ccf4dcb700.jpg saved to cache
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b
2026-04-27 08:12:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b, skipping ID generation
2026-04-27 08:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with scrape type 1
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64aaaa2e-7247-5393-aa1a-27eef7f57f9b sending to next pipeline
2026-04-27 08:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b, identifier: RR38517
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b79c50>
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3eece8c9caa8a3d9f7b50beeb541dd81.jpg saved to cache
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8
2026-04-27 08:12:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8, skipping ID generation
2026-04-27 08:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 1
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 sending to next pipeline
2026-04-27 08:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8, identifier: ZE64138
2026-04-27 08:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_65171c25bd3caf1f4da20b93fc9ba249.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with identifier: RR38517
2026-04-27 08:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with identifier: RR38517
2026-04-27 08:12:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64aaaa2e-7247-5393-aa1a-27eef7f57f9b with identifier: RR38517 to the API
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_ca4730ed1598749ae4b874ccf4dcb700.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'city': 'Rosenheim',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:12:53Z',
 'fuel_type': 'petrol',
 'id': '64aaaa2e-7247-5393-aa1a-27eef7f57f9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 47.855,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR38517',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'location_confidence': 'geocoded',
 'longitude': 12.1232,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 229652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_ca4730ed1598749ae4b874ccf4dcb700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_d311934d33fc5c2f4ea2e15ba1c01171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_c20449391aedcaabbdbf11c4f654460e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_863ec968c281c7b1faa0add179d49eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_64aaaa2e-7247-5393-aa1a-27eef7f57f9b/64aaaa2e-7247-5393-aa1a-27eef7f57f9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d7/64d77571568bc136b93cbb43f7cd5339/pa/RR38517_93b9d1cfff1a6be572e9c85c5bd15c9f.jpg',
             'Width': 800}],
 'postal_code': '83022',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2010-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-04-27 08:12:16 [auto1.de] INFO: Saving data for RR38517: {'created_time': 1777277536.548882, 'last_price_update_time': 1777277536.548894, 'has_photos': True, 'auction_closing_time': 1777389173.0}
2026-04-27 08:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-04-27 08:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-04-27 08:12:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138 to the API
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3eece8c9caa8a3d9f7b50beeb541dd81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'city': 'Buch',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:19:14Z',
 'fuel_type': 'diesel',
 'id': 'ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE64138',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 167222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_5ef6aa72711f13bb1a0c2f3b732ed5f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_16d936324418fefa0ec9af076fd191e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3eece8c9caa8a3d9f7b50beeb541dd81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_2cb106dcd49941029d34b342a7558043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3253fdf1e946c5f4960ad6b179e1e494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_18e449c2408adc4057784e07367e16d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_6455cb4d65ab5889567bfb99907ce387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_835a13fb174d9ae56cb66294a5f9462f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_b52d551ad6d883e75539bf99cf8d3b69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8/ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/9b/6d9b86776e33fad5b45dcf7ca04977e3/pa/ZE64138_3df6730078d082b543201b0acb1c21fa.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2019-06-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-04-27 08:12:16 [auto1.de] INFO: Saving data for ZE64138: {'created_time': 1777277536.864881, 'last_price_update_time': 1777277536.864891, 'has_photos': True, 'auction_closing_time': 1777389554.0}
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cee410>
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_b142e14d2160285032491f620583568d.jpg saved to cache
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd4c50>
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d3605d06281cd2969507e4d0d65bf7ca.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd6b50>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_36a4da04226494ee7ee9f0e6108e5b8e.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebe4290>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_65171c25bd3caf1f4da20b93fc9ba249.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d600e04c6cdcc40cf7fe92926d35dd50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_3c6fc580fe7653c763295731c5c2bb7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d43f2061f66fac7b138555d8dad57193.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_ff0de64f2b091d36c8a75cce0f068f7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014e450>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d600e04c6cdcc40cf7fe92926d35dd50.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46490>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_3c6fc580fe7653c763295731c5c2bb7a.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bb310>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d43f2061f66fac7b138555d8dad57193.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3010>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_ff0de64f2b091d36c8a75cce0f068f7a.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694ab02c-2af8-5d79-a53c-4590e10a36dc
2026-04-27 08:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 694ab02c-2af8-5d79-a53c-4590e10a36dc, skipping ID generation
2026-04-27 08:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694ab02c-2af8-5d79-a53c-4590e10a36dc with scrape type 1
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694ab02c-2af8-5d79-a53c-4590e10a36dc sending to next pipeline
2026-04-27 08:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 694ab02c-2af8-5d79-a53c-4590e10a36dc, identifier: HF53882
2026-04-27 08:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-04-27 08:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-04-27 08:12:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882 to the API
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_ff0de64f2b091d36c8a75cce0f068f7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Seddiner See',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:40:18Z',
 'fuel_type': 'petrol',
 'id': '694ab02c-2af8-5d79-a53c-4590e10a36dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF53882',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 25395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_ff0de64f2b091d36c8a75cce0f068f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d43f2061f66fac7b138555d8dad57193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d600e04c6cdcc40cf7fe92926d35dd50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_3c6fc580fe7653c763295731c5c2bb7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_d3605d06281cd2969507e4d0d65bf7ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_36a4da04226494ee7ee9f0e6108e5b8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_b142e14d2160285032491f620583568d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_65171c25bd3caf1f4da20b93fc9ba249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_c264dd327684799f9601ed2221bcf88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_694ab02c-2af8-5d79-a53c-4590e10a36dc/694ab02c-2af8-5d79-a53c-4590e10a36dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/b5/afb535014ee1c5fd2b4b0d1a4e85fe82/pa/HF53882_72029f7895c1d00e788fdb148dccba4d.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2019-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-04-27 08:12:18 [auto1.de] INFO: Saving data for HF53882: {'created_time': 1777277538.060735, 'last_price_update_time': 1777277538.060753, 'has_photos': True, 'auction_closing_time': 1777390818.0}
2026-04-27 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30074850>
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg saved to cache
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d4750>
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg saved to cache
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-04-27 08:12:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1daf73af-3354-5d41-a492-cd78cc06b189, skipping ID generation
2026-04-27 08:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 1
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1daf73af-3354-5d41-a492-cd78cc06b189 sending to next pipeline
2026-04-27 08:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1daf73af-3354-5d41-a492-cd78cc06b189, identifier: EC79074
2026-04-27 08:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-04-27 08:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-04-27 08:12:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074 to the API
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:08:25Z',
 'fuel_type': 'diesel',
 'id': '1daf73af-3354-5d41-a492-cd78cc06b189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79074',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 324456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2016-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-04-27 08:12:18 [auto1.de] INFO: Saving data for EC79074: {'created_time': 1777277538.681956, 'last_price_update_time': 1777277538.681967, 'has_photos': True, 'auction_closing_time': 1777388905.0}
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND10633> (referer: https://www.auto1.com/v1/car-details-view/ND10633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821e859e-5ea5-521b-82dc-3d5429508dca with identifier: ND10633
2026-04-27 08:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821e859e-5ea5-521b-82dc-3d5429508dca with scrape type 1
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_badca7bef8c3884035819205fbd3d5ee.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e8d68275591e124f4f262d62a41a8baf.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_5bf1c48aac3a44170e2a4988795546ae.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_997d8d3f4abb2b5ac3cb6d881dbcccdd.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_93761a0201deac6e4bdf79b1c150922e.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_581aea4ee9b01f771ef12aeed596f911.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_ce9daa9d6512c9c79b0b4ccd398ff577.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_f0188d5d489e858161d1950c38e79227.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_942455e550f2a12f29974e5690f9c7b1.jpg not downloaded yet
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e3008bbda42a398a4e0222ec8d71b388.jpg not downloaded yet
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH85131> (referer: https://www.auto1.com/v1/car-details-view/XH85131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84178059-7935-58a5-8333-6ffe90d2a8fd with identifier: XH85131
2026-04-27 08:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84178059-7935-58a5-8333-6ffe90d2a8fd with scrape type 1
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_52f46bb5dc08b994f2291daf0328bff0.jpg not downloaded yet
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e3008bbda42a398a4e0222ec8d71b388.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_ced00e39df864611aae1ffa97e514587.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_e02f9a42cf2deedf9a7ff6298ed9f71d.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_434985814561a55167e2ef9671c1af58.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_c5f2251852e8bb31f875d07257c7c3fd.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_b43a746cf05cb5789373b5bc2aed0735.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_326180f222a987e3e2fdd48a92b356d9.jpg not downloaded yet
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_52f46bb5dc08b994f2291daf0328bff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_439bb46a063018ba964801ec8790ea74.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_78ea3b05a828bd3bd93e793579494e7c.jpg not downloaded yet
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_2874804a60d55c17a98260c9b26d12e9.jpg not downloaded yet
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30056050>
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e3008bbda42a398a4e0222ec8d71b388.jpg saved to cache
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d52b10>
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_52f46bb5dc08b994f2291daf0328bff0.jpg saved to cache
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_326180f222a987e3e2fdd48a92b356d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca27d0>
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_326180f222a987e3e2fdd48a92b356d9.jpg saved to cache
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_2874804a60d55c17a98260c9b26d12e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015ac90>
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_2874804a60d55c17a98260c9b26d12e9.jpg saved to cache
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_78ea3b05a828bd3bd93e793579494e7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd3010>
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_78ea3b05a828bd3bd93e793579494e7c.jpg saved to cache
2026-04-27 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_439bb46a063018ba964801ec8790ea74.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d538d0>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_439bb46a063018ba964801ec8790ea74.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_b43a746cf05cb5789373b5bc2aed0735.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD23223> (referer: https://www.auto1.com/v1/car-details-view/LD23223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9f2d0>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_b43a746cf05cb5789373b5bc2aed0735.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-04-27 08:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 1
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg not downloaded yet
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg not downloaded yet
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg not downloaded yet
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_c5f2251852e8bb31f875d07257c7c3fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg not downloaded yet
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg not downloaded yet
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_434985814561a55167e2ef9671c1af58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecd290>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_c5f2251852e8bb31f875d07257c7c3fd.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd79d0>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_434985814561a55167e2ef9671c1af58.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014d250>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22bd6c10>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cefdd0>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg saved to cache
2026-04-27 08:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_ced00e39df864611aae1ffa97e514587.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f7750>
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg saved to cache
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003fa10>
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg saved to cache
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-04-27 08:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27, skipping ID generation
2026-04-27 08:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 1
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 sending to next pipeline
2026-04-27 08:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27, identifier: LD23223
2026-04-27 08:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-04-27 08:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-04-27 08:12:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223 to the API
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'city': 'Hemau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-04-28T15:54:10Z',
 'fuel_type': 'petrol',
 'id': 'dbd2ab22-fdc4-50c3-bc3f-24b547e41b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.0383,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD23223',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'location_confidence': 'geocoded',
 'longitude': 11.8522,
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 106954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg',
             'Width': 800}],
 'postal_code': '93155',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Palatinate',
 'province_code': 'DE-093',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2007-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2007}
2026-04-27 08:12:27 [auto1.de] INFO: Saving data for LD23223: {'created_time': 1777277547.604862, 'last_price_update_time': 1777277547.604872, 'has_photos': True, 'auction_closing_time': 1777391650.0}
2026-04-27 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_942455e550f2a12f29974e5690f9c7b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_e02f9a42cf2deedf9a7ff6298ed9f71d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014d950>
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_ced00e39df864611aae1ffa97e514587.jpg saved to cache
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK68115> (referer: https://www.auto1.com/v1/car-details-view/UK68115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300752d0>
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_942455e550f2a12f29974e5690f9c7b1.jpg saved to cache
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d890>
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_e02f9a42cf2deedf9a7ff6298ed9f71d.jpg saved to cache
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84178059-7935-58a5-8333-6ffe90d2a8fd
2026-04-27 08:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84178059-7935-58a5-8333-6ffe90d2a8fd, skipping ID generation
2026-04-27 08:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84178059-7935-58a5-8333-6ffe90d2a8fd with scrape type 1
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84178059-7935-58a5-8333-6ffe90d2a8fd sending to next pipeline
2026-04-27 08:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84178059-7935-58a5-8333-6ffe90d2a8fd, identifier: XH85131
2026-04-27 08:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84178059-7935-58a5-8333-6ffe90d2a8fd with identifier: XH85131
2026-04-27 08:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84178059-7935-58a5-8333-6ffe90d2a8fd with identifier: XH85131
2026-04-27 08:12:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84178059-7935-58a5-8333-6ffe90d2a8fd with identifier: XH85131 to the API
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_e02f9a42cf2deedf9a7ff6298ed9f71d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'city': 'Kippenheim',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:28:31Z',
 'fuel_type': 'petrol',
 'id': '84178059-7935-58a5-8333-6ffe90d2a8fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH85131',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 31297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_52f46bb5dc08b994f2291daf0328bff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_ced00e39df864611aae1ffa97e514587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_e02f9a42cf2deedf9a7ff6298ed9f71d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_434985814561a55167e2ef9671c1af58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_c5f2251852e8bb31f875d07257c7c3fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_b43a746cf05cb5789373b5bc2aed0735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_326180f222a987e3e2fdd48a92b356d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_439bb46a063018ba964801ec8790ea74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_78ea3b05a828bd3bd93e793579494e7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_84178059-7935-58a5-8333-6ffe90d2a8fd/84178059-7935-58a5-8333-6ffe90d2a8fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/d1/99d1d4377f1b37bd902f4acfb5a8555d/pa/XH85131_2874804a60d55c17a98260c9b26d12e9.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2018-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2018}
2026-04-27 08:12:28 [auto1.de] INFO: Saving data for XH85131: {'created_time': 1777277548.360895, 'last_price_update_time': 1777277548.360906, 'has_photos': True, 'auction_closing_time': 1777390111.0}
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_f0188d5d489e858161d1950c38e79227.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_ce9daa9d6512c9c79b0b4ccd398ff577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_581aea4ee9b01f771ef12aeed596f911.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT58505> (referer: https://www.auto1.com/v1/car-details-view/GT58505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with identifier: UK68115
2026-04-27 08:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with scrape type 1
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_48974035ba07fe7628195caadb152b1d.jpg not downloaded yet
2026-04-27 08:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_2a23aa66ea1b382a6eb911c20c60be4a.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_ef07cc6a60c6a50c8682817e09f585d7.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_4b983ce3bbb8f98ef56f51090d5a6af8.jpg not downloaded yet
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_997d8d3f4abb2b5ac3cb6d881dbcccdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_50a637f16b25b13333e8076291e8e1ac.jpg not downloaded yet
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e8d68275591e124f4f262d62a41a8baf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_62cee443c4f0dad57ccb9a36ce680898.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_7d90b877192c7805beffcf39498bfdf8.jpg not downloaded yet
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f080d0>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_f0188d5d489e858161d1950c38e79227.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30196b90>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_ce9daa9d6512c9c79b0b4ccd398ff577.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ae2d0>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_581aea4ee9b01f771ef12aeed596f911.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-04-27 08:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80575c14-2724-516a-b461-11717f3f23a2 with scrape type 1
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_bf8cb1b548151c9b36c0aee1889fd557.jpg not downloaded yet
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_93761a0201deac6e4bdf79b1c150922e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_c72216df412717e39d4c609541dec8be.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3982a69504d45cf34052bf6be0580e77.jpg not downloaded yet
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_5bf1c48aac3a44170e2a4988795546ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_4b983ce3bbb8f98ef56f51090d5a6af8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_a816ffbeb32e338a48b1ffb447c645e7.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_f63f3e2d0d14661c33ed9432d6913bbe.jpg not downloaded yet
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67710>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_997d8d3f4abb2b5ac3cb6d881dbcccdd.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208a2d0>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e8d68275591e124f4f262d62a41a8baf.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_ef07cc6a60c6a50c8682817e09f585d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_d51742f25e65af4ef2321e70ed88be63.jpg not downloaded yet
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_0f6d71fa354b790abc27752d1d9533ae.jpg not downloaded yet
2026-04-27 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_bf8cb1b548151c9b36c0aee1889fd557.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9cf10>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_93761a0201deac6e4bdf79b1c150922e.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30259a10>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_5bf1c48aac3a44170e2a4988795546ae.jpg saved to cache
2026-04-27 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300e9790>
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_4b983ce3bbb8f98ef56f51090d5a6af8.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_7d11ce2cd061e3a0b8a56ed0eae4d5d7.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_7d90b877192c7805beffcf39498bfdf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_2b81f512796093547cf685454f872425.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eab1d50>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_ef07cc6a60c6a50c8682817e09f585d7.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6b110>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_bf8cb1b548151c9b36c0aee1889fd557.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3e1db7a6bfccd07bf52ee7860f55ec80.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3982a69504d45cf34052bf6be0580e77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_000851d4bcf694ff42ccfa39968c83b1.jpg not downloaded yet
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_c7f64593224b13ae9c9612a46842cf1f.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c590>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_7d90b877192c7805beffcf39498bfdf8.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_a816ffbeb32e338a48b1ffb447c645e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_94ef76b0c948ed6a09bb136fa9c82e5f.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_f63f3e2d0d14661c33ed9432d6913bbe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ca31d0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3982a69504d45cf34052bf6be0580e77.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2ebd0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_a816ffbeb32e338a48b1ffb447c645e7.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_7d11ce2cd061e3a0b8a56ed0eae4d5d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG43188> (referer: https://www.auto1.com/v1/car-details-view/HG43188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f3950>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_f63f3e2d0d14661c33ed9432d6913bbe.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_2b81f512796093547cf685454f872425.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_c7f64593224b13ae9c9612a46842cf1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d0b50>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_7d11ce2cd061e3a0b8a56ed0eae4d5d7.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_000851d4bcf694ff42ccfa39968c83b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-04-27 08:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 with scrape type 1
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d697d0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_2b81f512796093547cf685454f872425.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_94ef76b0c948ed6a09bb136fa9c82e5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_0f6d71fa354b790abc27752d1d9533ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd6890>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_c7f64593224b13ae9c9612a46842cf1f.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_d51742f25e65af4ef2321e70ed88be63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f3550>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_000851d4bcf694ff42ccfa39968c83b1.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_c72216df412717e39d4c609541dec8be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301ddbd0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_94ef76b0c948ed6a09bb136fa9c82e5f.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd1f50>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_0f6d71fa354b790abc27752d1d9533ae.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80575c14-2724-516a-b461-11717f3f23a2
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_62cee443c4f0dad57ccb9a36ce680898.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049990>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_d51742f25e65af4ef2321e70ed88be63.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg not downloaded yet
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcefd0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9dcd0>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_c72216df412717e39d4c609541dec8be.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8a650>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301dfd10>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_62cee443c4f0dad57ccb9a36ce680898.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22feb150>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da24d0>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22efae90>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea8110>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_50a637f16b25b13333e8076291e8e1ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_48974035ba07fe7628195caadb152b1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_badca7bef8c3884035819205fbd3d5ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceaf90>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30056490>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004fa90>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_2a23aa66ea1b382a6eb911c20c60be4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee6490>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_50a637f16b25b13333e8076291e8e1ac.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a2390>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg saved to cache
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-04-27 08:12:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45dec50c-ac33-5893-96d7-8a020af7a3b5, skipping ID generation
2026-04-27 08:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 with scrape type 1
2026-04-27 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 sending to next pipeline
2026-04-27 08:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45dec50c-ac33-5893-96d7-8a020af7a3b5, identifier: HG43188
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004a110>
2026-04-27 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_48974035ba07fe7628195caadb152b1d.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004f9d0>
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_badca7bef8c3884035819205fbd3d5ee.jpg saved to cache
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 821e859e-5ea5-521b-82dc-3d5429508dca
2026-04-27 08:12:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 821e859e-5ea5-521b-82dc-3d5429508dca, skipping ID generation
2026-04-27 08:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821e859e-5ea5-521b-82dc-3d5429508dca with scrape type 1
2026-04-27 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 821e859e-5ea5-521b-82dc-3d5429508dca sending to next pipeline
2026-04-27 08:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821e859e-5ea5-521b-82dc-3d5429508dca, identifier: ND10633
2026-04-27 08:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-04-27 08:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-04-27 08:12:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188 to the API
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'city': 'Ellerau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-04-28T15:41:44Z',
 'fuel_type': 'diesel',
 'id': '45dec50c-ac33-5893-96d7-8a020af7a3b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG43188',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 252957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2014-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-04-27 08:12:31 [auto1.de] INFO: Saving data for HG43188: {'created_time': 1777277551.967112, 'last_price_update_time': 1777277551.967121, 'has_photos': True, 'auction_closing_time': 1777390904.0}
2026-04-27 08:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821e859e-5ea5-521b-82dc-3d5429508dca with identifier: ND10633
2026-04-27 08:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821e859e-5ea5-521b-82dc-3d5429508dca with identifier: ND10633
2026-04-27 08:12:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821e859e-5ea5-521b-82dc-3d5429508dca with identifier: ND10633 to the API
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_badca7bef8c3884035819205fbd3d5ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'category': None,
 'city': 'Helvesiek',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.6L',
 'engine_horse_power': 300,
 'expiration_date': '2026-04-28T15:13:18Z',
 'fuel_type': 'petrol',
 'id': '821e859e-5ea5-521b-82dc-3d5429508dca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.2161,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND10633',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'location_confidence': 'geocoded',
 'longitude': 9.4915,
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 163247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_badca7bef8c3884035819205fbd3d5ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e8d68275591e124f4f262d62a41a8baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_5bf1c48aac3a44170e2a4988795546ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_997d8d3f4abb2b5ac3cb6d881dbcccdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_93761a0201deac6e4bdf79b1c150922e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_581aea4ee9b01f771ef12aeed596f911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_ce9daa9d6512c9c79b0b4ccd398ff577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_f0188d5d489e858161d1950c38e79227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_942455e550f2a12f29974e5690f9c7b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_821e859e-5ea5-521b-82dc-3d5429508dca/821e859e-5ea5-521b-82dc-3d5429508dca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/91/8491febe2e58a28113d1635184982cb2/pa/ND10633_e3008bbda42a398a4e0222ec8d71b388.jpg',
             'Width': 800}],
 'postal_code': '27389',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2010-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Panamera 4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-04-27 08:12:32 [auto1.de] INFO: Saving data for ND10633: {'created_time': 1777277552.304974, 'last_price_update_time': 1777277552.304983, 'has_photos': True, 'auction_closing_time': 1777389198.0}
2026-04-27 08:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-04-27 08:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-04-27 08:12:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505 to the API
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:32 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': 'Rental',
 'city': 'Schkopau',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:40:30Z',
 'fuel_type': 'diesel',
 'id': '80575c14-2724-516a-b461-11717f3f23a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT58505',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 177752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_bf8cb1b548151c9b36c0aee1889fd557.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3982a69504d45cf34052bf6be0580e77.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_f63f3e2d0d14661c33ed9432d6913bbe.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_0f6d71fa354b790abc27752d1d9533ae.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_7d11ce2cd061e3a0b8a56ed0eae4d5d7.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_2b81f512796093547cf685454f872425.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3e1db7a6bfccd07bf52ee7860f55ec80.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_000851d4bcf694ff42ccfa39968c83b1.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_c7f64593224b13ae9c9612a46842cf1f.jpg',
                'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_94ef76b0c948ed6a09bb136fa9c82e5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_bf8cb1b548151c9b36c0aee1889fd557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_3982a69504d45cf34052bf6be0580e77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_f63f3e2d0d14661c33ed9432d6913bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_0f6d71fa354b790abc27752d1d9533ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_7d11ce2cd061e3a0b8a56ed0eae4d5d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_2b81f512796093547cf685454f872425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_000851d4bcf694ff42ccfa39968c83b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_c7f64593224b13ae9c9612a46842cf1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_80575c14-2724-516a-b461-11717f3f23a2/80575c14-2724-516a-b461-11717f3f23a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/69/f069a0d0aefc7166822dd2e3e252effe/pa/GT58505_94ef76b0c948ed6a09bb136fa9c82e5f.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2013-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-04-27 08:12:32 [auto1.de] INFO: Saving data for GT58505: {'created_time': 1777277552.65171, 'last_price_update_time': 1777277552.651721, 'has_photos': True, 'auction_closing_time': 1777390830.0}
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 80575c14-2724-516a-b461-11717f3f23a2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f20d0>
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_2a23aa66ea1b382a6eb911c20c60be4a.jpg saved to cache
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe
2026-04-27 08:12:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe, skipping ID generation
2026-04-27 08:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with scrape type 1
2026-04-27 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8c2becb-97e3-5a48-81c5-a1b44b70f3fe sending to next pipeline
2026-04-27 08:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe, identifier: UK68115
2026-04-27 08:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with identifier: UK68115
2026-04-27 08:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with identifier: UK68115
2026-04-27 08:12:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c2becb-97e3-5a48-81c5-a1b44b70f3fe with identifier: UK68115 to the API
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_2a23aa66ea1b382a6eb911c20c60be4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'city': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'engine_horse_power': 462,
 'expiration_date': '2026-04-28T15:00:45Z',
 'fuel_type': 'petrol',
 'id': 'e8c2becb-97e3-5a48-81c5-a1b44b70f3fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': None,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK68115',
 'listing': 'auction',
 'location': 'DE',
 'location_confidence': None,
 'longitude': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 114040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_48974035ba07fe7628195caadb152b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_2a23aa66ea1b382a6eb911c20c60be4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_ef07cc6a60c6a50c8682817e09f585d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_4b983ce3bbb8f98ef56f51090d5a6af8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_50a637f16b25b13333e8076291e8e1ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_62cee443c4f0dad57ccb9a36ce680898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_7d90b877192c7805beffcf39498bfdf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_c72216df412717e39d4c609541dec8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_a816ffbeb32e338a48b1ffb447c645e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e8c2becb-97e3-5a48-81c5-a1b44b70f3fe/e8c2becb-97e3-5a48-81c5-a1b44b70f3fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/10/f41038c2678bd0fa7864cec590efd326/pa/UK68115_d51742f25e65af4ef2321e70ed88be63.jpg',
             'Width': 800}],
 'postal_code': None,
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': None,
 'region': None,
 'region_code': None,
 'registration_date': '2018-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er M550i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2018}
2026-04-27 08:12:33 [auto1.de] INFO: Saving data for UK68115: {'created_time': 1777277553.11792, 'last_price_update_time': 1777277553.117932, 'has_photos': True, 'auction_closing_time': 1777388445.0}
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG08115> (referer: https://www.auto1.com/v1/car-details-view/CG08115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-04-27 08:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f869b4-4509-57d3-a042-637a4f5ba29e with scrape type 1
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg not downloaded yet
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg not downloaded yet
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg not downloaded yet
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg not downloaded yet
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg not downloaded yet
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.154(s), this was the 1st time calling it.
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.633340235765298 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:43 [scrapy.extensions.logstats] INFO: Crawled 692 pages (at 23 pages/min), scraped 313 items (at 12 items/min)
2026-04-27 08:12:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.370(s), this was the 1st time calling it.
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.220555854370605 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT30217> (referer: https://www.auto1.com/v1/car-details-view/RT30217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa79f73-f5c8-568f-9f89-4213fec252bf with identifier: RT30217
2026-04-27 08:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa79f73-f5c8-568f-9f89-4213fec252bf with scrape type 1
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9ffa71c5591c4123c6c5c85759c8218b.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_5dba362a93822eefe8ea2f6eb41a48e7.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_21ce19cf5eb2509255f98c01405844f1.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9a5be4555f90eff9819bbe9a5ad39bcf.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_2227a277489d50fabfeff46f500bf86a.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_189e801cd373867d61a1ddb448910506.jpg not downloaded yet
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_468a54049798c00281674309b0427e3e.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_c374a3e49a2731b1226d926a09043f36.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_7c3328e7d1141fb86bc1c872a6fe4b40.jpg not downloaded yet
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_b05bd552e0508488f3768632f2a5c421.jpg not downloaded yet
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05dd0>
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_189e801cd373867d61a1ddb448910506.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e22790>
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_189e801cd373867d61a1ddb448910506.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_b05bd552e0508488f3768632f2a5c421.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22caff10>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_b05bd552e0508488f3768632f2a5c421.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_7c3328e7d1141fb86bc1c872a6fe4b40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5e90>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_7c3328e7d1141fb86bc1c872a6fe4b40.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_c374a3e49a2731b1226d926a09043f36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad250>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_c374a3e49a2731b1226d926a09043f36.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_468a54049798c00281674309b0427e3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e234d0>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_468a54049798c00281674309b0427e3e.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_2227a277489d50fabfeff46f500bf86a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0350>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_2227a277489d50fabfeff46f500bf86a.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9a5be4555f90eff9819bbe9a5ad39bcf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67310>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9a5be4555f90eff9819bbe9a5ad39bcf.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_21ce19cf5eb2509255f98c01405844f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30040950>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_21ce19cf5eb2509255f98c01405844f1.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_5dba362a93822eefe8ea2f6eb41a48e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9ffa71c5591c4123c6c5c85759c8218b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300eb4d0>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_5dba362a93822eefe8ea2f6eb41a48e7.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f651d0>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9ffa71c5591c4123c6c5c85759c8218b.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffa79f73-f5c8-568f-9f89-4213fec252bf
2026-04-27 08:12:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffa79f73-f5c8-568f-9f89-4213fec252bf, skipping ID generation
2026-04-27 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa79f73-f5c8-568f-9f89-4213fec252bf with scrape type 1
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffa79f73-f5c8-568f-9f89-4213fec252bf sending to next pipeline
2026-04-27 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffa79f73-f5c8-568f-9f89-4213fec252bf, identifier: RT30217
2026-04-27 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffa79f73-f5c8-568f-9f89-4213fec252bf with identifier: RT30217
2026-04-27 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffa79f73-f5c8-568f-9f89-4213fec252bf with identifier: RT30217
2026-04-27 08:12:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffa79f73-f5c8-568f-9f89-4213fec252bf with identifier: RT30217 to the API
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9ffa71c5591c4123c6c5c85759c8218b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'city': 'Bremerhaven',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-04-28T15:52:24Z',
 'fuel_type': 'diesel',
 'id': 'ffa79f73-f5c8-568f-9f89-4213fec252bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.5687,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT30217',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'location_confidence': 'geocoded',
 'longitude': 8.5741,
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 161824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9ffa71c5591c4123c6c5c85759c8218b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_5dba362a93822eefe8ea2f6eb41a48e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_21ce19cf5eb2509255f98c01405844f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_9a5be4555f90eff9819bbe9a5ad39bcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_2227a277489d50fabfeff46f500bf86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_189e801cd373867d61a1ddb448910506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_468a54049798c00281674309b0427e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_c374a3e49a2731b1226d926a09043f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_7c3328e7d1141fb86bc1c872a6fe4b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ffa79f73-f5c8-568f-9f89-4213fec252bf/ffa79f73-f5c8-568f-9f89-4213fec252bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ee/adeec446a84097ad588a1083ac152af8/pa/RT30217_b05bd552e0508488f3768632f2a5c421.jpg',
             'Width': 800}],
 'postal_code': '27568',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Bremen',
 'region_code': 'DE-HB',
 'registration_date': '2016-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2016}
2026-04-27 08:12:50 [auto1.de] INFO: Saving data for RT30217: {'created_time': 1777277570.962089, 'last_price_update_time': 1777277570.962099, 'has_photos': True, 'auction_closing_time': 1777391544.0}
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b86590>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b06a90>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a13590>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b01650>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51f869b4-4509-57d3-a042-637a4f5ba29e
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51f869b4-4509-57d3-a042-637a4f5ba29e, skipping ID generation
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f869b4-4509-57d3-a042-637a4f5ba29e with scrape type 1
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51f869b4-4509-57d3-a042-637a4f5ba29e sending to next pipeline
2026-04-27 08:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51f869b4-4509-57d3-a042-637a4f5ba29e, identifier: CG08115
2026-04-27 08:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-04-27 08:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115
2026-04-27 08:12:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51f869b4-4509-57d3-a042-637a4f5ba29e with identifier: CG08115 to the API
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'city': 'Saarlouis',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:52:22Z',
 'fuel_type': 'petrol',
 'id': '51f869b4-4509-57d3-a042-637a4f5ba29e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.3137,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG08115',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'location_confidence': 'geocoded',
 'longitude': 6.7515,
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 202819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_a165b387e6afd6704d5dad5d26325f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_4d3f1ea3f9a1ab18b7480424e0ea3325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f55574f07dc54a2c62e11ae75f5ea122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_3a5279344748952b110ea3f75c42827f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51f869b4-4509-57d3-a042-637a4f5ba29e/51f869b4-4509-57d3-a042-637a4f5ba29e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/b8/2cb8111fdcb19994b7cab9efd3b82b69/pa/CG08115_f973796a2b5797d3ce6df98fd79b4bc4.jpg',
             'Width': 800}],
 'postal_code': '66740',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Saarland',
 'region_code': 'DE-SL',
 'registration_date': '2011-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2011}
2026-04-27 08:12:52 [auto1.de] INFO: Saving data for CG08115: {'created_time': 1777277572.121279, 'last_price_update_time': 1777277572.121295, 'has_photos': True, 'auction_closing_time': 1777391542.0}
2026-04-27 08:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:13:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.193(s), this was the 1st time calling it.
2026-04-27 08:13:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.123317523811717 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB92040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF13899> (referer: https://www.auto1.com/v1/car-details-view/NF13899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-04-27 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with scrape type 1
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_e2511d13fa602da3ef23a4114a06843c.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_277fff963c4ed8612bb13d58ec8be169.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_a458d9a0de48879dfd3747ad21ab8179.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_7a5f12666d917688b6faf27ef468098b.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_526f194e2f4fee5bbcb53d377c0e0a14.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_c68661e1e4224b32680338c80d710ad4.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_0e08c9dee93a0e514dc126fddc4ca23b.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_8b3f9a0da6c85ded1705487df01e7916.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_df4c2adbb6981d6ff5d50b51d7bee562.jpg not downloaded yet
2026-04-27 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_80a5de776dc89f754952177e5a9c4a4c.jpg not downloaded yet
2026-04-27 08:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV45977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_80a5de776dc89f754952177e5a9c4a4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46550>
2026-04-27 08:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_80a5de776dc89f754952177e5a9c4a4c.jpg saved to cache
2026-04-27 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB51072/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_df4c2adbb6981d6ff5d50b51d7bee562.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22caf9d0>
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_df4c2adbb6981d6ff5d50b51d7bee562.jpg saved to cache
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM30450/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_8b3f9a0da6c85ded1705487df01e7916.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d910>
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_8b3f9a0da6c85ded1705487df01e7916.jpg saved to cache
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN73895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_0e08c9dee93a0e514dc126fddc4ca23b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3028ddd0>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_0e08c9dee93a0e514dc126fddc4ca23b.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:15 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 10687 | hits on page: 40
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: KP66478
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for KP66478: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: UP81002
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for UP81002: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: RT30217
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for RT30217: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: LD23223
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for LD23223: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: UK68115
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for UK68115: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: XC77974
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_c68661e1e4224b32680338c80d710ad4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: XH85131
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for XH85131: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: RR38517
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for RR38517: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: HG43188
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for HG43188: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: ZE64138
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: ND10633
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for ND10633: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: KZ71563
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: GT58505
2026-04-27 08:13:15 [auto1.de] INFO: Scrape type for GT58505: 0
2026-04-27 08:13:15 [auto1.de] INFO: Found listing with ID: PV12364
2026-04-27 08:13:15 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:15 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302f3550>
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_c68661e1e4224b32680338c80d710ad4.jpg saved to cache
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.640(s), this was the 2nd time calling it.
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.886934013829914 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP40220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_526f194e2f4fee5bbcb53d377c0e0a14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0150>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_526f194e2f4fee5bbcb53d377c0e0a14.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV94490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_7a5f12666d917688b6faf27ef468098b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1b90>
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_7a5f12666d917688b6faf27ef468098b.jpg saved to cache
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL59666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_a458d9a0de48879dfd3747ad21ab8179.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73890>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_a458d9a0de48879dfd3747ad21ab8179.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX12342> (referer: https://www.auto1.com/v1/car-details-view/TX12342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96804633-9ca9-541c-8a4c-2892a526c475 with identifier: TX12342
2026-04-27 08:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96804633-9ca9-541c-8a4c-2892a526c475 with scrape type 1
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_ea171f1f87e8f6e3a0a5ec156e487077.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_3a33479980a133658975f33b547a0df0.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0b22bc42cd047bd60cb5e6153d59d30f.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1a76b43a7885f3c02e40c82dd46272ae.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_f28ea6651ee54762cd65c27a1bbd1d99.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_a99b30cd5e1c3db444c1cb157522f5bd.jpg not downloaded yet
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_277fff963c4ed8612bb13d58ec8be169.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_367670012ded1a753f103fc0d928f0b6.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1e4e1652c550ae7efc8f9c79526c4cc0.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_d60ba9a9cfefc51d0f99379dac053906.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0da4e77123ee1d9afc4e004da288ce4a.jpg not downloaded yet
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f6a1d0>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_277fff963c4ed8612bb13d58ec8be169.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_a99b30cd5e1c3db444c1cb157522f5bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d91310>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_a99b30cd5e1c3db444c1cb157522f5bd.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0da4e77123ee1d9afc4e004da288ce4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1b50>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0da4e77123ee1d9afc4e004da288ce4a.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_d60ba9a9cfefc51d0f99379dac053906.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a13c10>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_d60ba9a9cfefc51d0f99379dac053906.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1e4e1652c550ae7efc8f9c79526c4cc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f2750>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1e4e1652c550ae7efc8f9c79526c4cc0.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_367670012ded1a753f103fc0d928f0b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf2190>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_367670012ded1a753f103fc0d928f0b6.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_f28ea6651ee54762cd65c27a1bbd1d99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73fd0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_f28ea6651ee54762cd65c27a1bbd1d99.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1a76b43a7885f3c02e40c82dd46272ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a11850>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1a76b43a7885f3c02e40c82dd46272ae.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0b22bc42cd047bd60cb5e6153d59d30f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bb010>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0b22bc42cd047bd60cb5e6153d59d30f.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_3a33479980a133658975f33b547a0df0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_ea171f1f87e8f6e3a0a5ec156e487077.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d1910>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_3a33479980a133658975f33b547a0df0.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_e2511d13fa602da3ef23a4114a06843c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf2550>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_ea171f1f87e8f6e3a0a5ec156e487077.jpg saved to cache
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96804633-9ca9-541c-8a4c-2892a526c475
2026-04-27 08:13:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96804633-9ca9-541c-8a4c-2892a526c475, skipping ID generation
2026-04-27 08:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96804633-9ca9-541c-8a4c-2892a526c475 with scrape type 1
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96804633-9ca9-541c-8a4c-2892a526c475 sending to next pipeline
2026-04-27 08:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96804633-9ca9-541c-8a4c-2892a526c475, identifier: TX12342
2026-04-27 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96804633-9ca9-541c-8a4c-2892a526c475 with identifier: TX12342
2026-04-27 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96804633-9ca9-541c-8a4c-2892a526c475 with identifier: TX12342
2026-04-27 08:13:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96804633-9ca9-541c-8a4c-2892a526c475 with identifier: TX12342 to the API
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_ea171f1f87e8f6e3a0a5ec156e487077.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Buch',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-04-28T15:18:14Z',
 'fuel_type': 'petrol',
 'id': '96804633-9ca9-541c-8a4c-2892a526c475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2248,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX12342',
 'listing': 'auction',
 'location': 'DE, Buch',
 'location_confidence': 'geocoded',
 'longitude': 10.1805,
 'make': 'BMW',
 'model': '2er',
 'odometer': 105278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_ea171f1f87e8f6e3a0a5ec156e487077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_3a33479980a133658975f33b547a0df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0b22bc42cd047bd60cb5e6153d59d30f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1a76b43a7885f3c02e40c82dd46272ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_f28ea6651ee54762cd65c27a1bbd1d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_a99b30cd5e1c3db444c1cb157522f5bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_367670012ded1a753f103fc0d928f0b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_1e4e1652c550ae7efc8f9c79526c4cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_d60ba9a9cfefc51d0f99379dac053906.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_96804633-9ca9-541c-8a4c-2892a526c475/96804633-9ca9-541c-8a4c-2892a526c475_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/0a/190aa6324487ae422114d01d18fe78a0/pa/TX12342_0da4e77123ee1d9afc4e004da288ce4a.jpg',
             'Width': 800}],
 'postal_code': '89290',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Swabia',
 'province_code': 'DE-097',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2015-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-04-27 08:13:34 [auto1.de] INFO: Saving data for TX12342: {'created_time': 1777277614.060616, 'last_price_update_time': 1777277614.060629, 'has_photos': True, 'auction_closing_time': 1777389494.0}
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcefd0>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_e2511d13fa602da3ef23a4114a06843c.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356
2026-04-27 08:13:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356, skipping ID generation
2026-04-27 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with scrape type 1
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 sending to next pipeline
2026-04-27 08:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356, identifier: NF13899
2026-04-27 08:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-04-27 08:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-04-27 08:13:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899 to the API
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_e2511d13fa602da3ef23a4114a06843c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Ellerau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-04-28T15:18:39Z',
 'fuel_type': 'diesel',
 'id': '7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF13899',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 233503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_e2511d13fa602da3ef23a4114a06843c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_277fff963c4ed8612bb13d58ec8be169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_a458d9a0de48879dfd3747ad21ab8179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_7a5f12666d917688b6faf27ef468098b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_526f194e2f4fee5bbcb53d377c0e0a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_c68661e1e4224b32680338c80d710ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_0e08c9dee93a0e514dc126fddc4ca23b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_8b3f9a0da6c85ded1705487df01e7916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_df4c2adbb6981d6ff5d50b51d7bee562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356/7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/15/e015e1b30baefa216ddbda60dce76f42/pa/NF13899_80a5de776dc89f754952177e5a9c4a4c.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2016-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2016}
2026-04-27 08:13:34 [auto1.de] INFO: Saving data for NF13899: {'created_time': 1777277614.90548, 'last_price_update_time': 1777277614.905489, 'has_photos': True, 'auction_closing_time': 1777389519.0}
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ97454> (referer: https://www.auto1.com/v1/car-details-view/GJ97454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with identifier: GJ97454
2026-04-27 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with scrape type 1
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_7255fadda2943e6a086848dd11a101e3.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_e4015df4b5666fb1bfbbe62e12585180.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_45f84e40a5e850018ffec14c7612ccd6.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_6616265f1c9b1986b1fecc059290baa9.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_53ccd6510ca49ff376b54936864905bb.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b6cde8b240b9bee39d4f67a5f0cb0ad3.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_2d4afa06a30a6437cf917d2e77fc90b3.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_17d0b7a16c4597b8781393ed2c18e55f.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_58c65b3100e5d270ade2de4cd90a1783.jpg not downloaded yet
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b68527605d268a9d266b35f213c22e79.jpg not downloaded yet
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB51072> (referer: https://www.auto1.com/v1/car-details-view/WB51072/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c998aee8-771f-5e81-bb5e-1c7372b4afa3 with identifier: WB51072
2026-04-27 08:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c998aee8-771f-5e81-bb5e-1c7372b4afa3 with scrape type 1
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_ace51cabe531b787e5acb72f814072dd.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_e5b00c3d7454f4641be3f82b11c1f7cb.jpg not downloaded yet
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b68527605d268a9d266b35f213c22e79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a83f4d634f8bb6c19521340b63a3f23b.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_d4a840348888736f62675a1113aba910.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_014d5330972e1726b55e67bad34a5e35.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_3315989551d733cb0f076a89d078c06f.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_02dcc47ee970fd37311f9c5f81a7bf8a.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a9c1964877d13e48602c015810d05d61.jpg not downloaded yet
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_ace51cabe531b787e5acb72f814072dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_f21bdb824e9e0a726f52b1ff3779a3f7.jpg not downloaded yet
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_af46a8f72c105d9227c04db201e9f415.jpg not downloaded yet
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e21750>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b68527605d268a9d266b35f213c22e79.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a9c1964877d13e48602c015810d05d61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f2190>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_ace51cabe531b787e5acb72f814072dd.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_af46a8f72c105d9227c04db201e9f415.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3050>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a9c1964877d13e48602c015810d05d61.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ac3d0>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_af46a8f72c105d9227c04db201e9f415.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_f21bdb824e9e0a726f52b1ff3779a3f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c610>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_f21bdb824e9e0a726f52b1ff3779a3f7.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_02dcc47ee970fd37311f9c5f81a7bf8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_3315989551d733cb0f076a89d078c06f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46510>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_02dcc47ee970fd37311f9c5f81a7bf8a.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44e10>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_3315989551d733cb0f076a89d078c06f.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_014d5330972e1726b55e67bad34a5e35.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41b50>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_014d5330972e1726b55e67bad34a5e35.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_d4a840348888736f62675a1113aba910.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a83f4d634f8bb6c19521340b63a3f23b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba41d0>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_d4a840348888736f62675a1113aba910.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_e5b00c3d7454f4641be3f82b11c1f7cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30041c50>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a83f4d634f8bb6c19521340b63a3f23b.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3208a2d0>
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_e5b00c3d7454f4641be3f82b11c1f7cb.jpg saved to cache
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c998aee8-771f-5e81-bb5e-1c7372b4afa3
2026-04-27 08:13:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c998aee8-771f-5e81-bb5e-1c7372b4afa3, skipping ID generation
2026-04-27 08:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c998aee8-771f-5e81-bb5e-1c7372b4afa3 with scrape type 1
2026-04-27 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c998aee8-771f-5e81-bb5e-1c7372b4afa3 sending to next pipeline
2026-04-27 08:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c998aee8-771f-5e81-bb5e-1c7372b4afa3, identifier: WB51072
2026-04-27 08:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c998aee8-771f-5e81-bb5e-1c7372b4afa3 with identifier: WB51072
2026-04-27 08:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c998aee8-771f-5e81-bb5e-1c7372b4afa3 with identifier: WB51072
2026-04-27 08:13:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c998aee8-771f-5e81-bb5e-1c7372b4afa3 with identifier: WB51072 to the API
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_e5b00c3d7454f4641be3f82b11c1f7cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'city': 'Ketzin',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-04-28T15:28:52Z',
 'fuel_type': 'diesel',
 'id': 'c998aee8-771f-5e81-bb5e-1c7372b4afa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB51072',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 92785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_ace51cabe531b787e5acb72f814072dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_e5b00c3d7454f4641be3f82b11c1f7cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a83f4d634f8bb6c19521340b63a3f23b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_d4a840348888736f62675a1113aba910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_014d5330972e1726b55e67bad34a5e35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_3315989551d733cb0f076a89d078c06f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_02dcc47ee970fd37311f9c5f81a7bf8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_a9c1964877d13e48602c015810d05d61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_f21bdb824e9e0a726f52b1ff3779a3f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c998aee8-771f-5e81-bb5e-1c7372b4afa3/c998aee8-771f-5e81-bb5e-1c7372b4afa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/50/1650e5e93a3c06441fa57642af9b53c3/pa/WB51072_af46a8f72c105d9227c04db201e9f415.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2021}
2026-04-27 08:13:38 [auto1.de] INFO: Saving data for WB51072: {'created_time': 1777277618.429965, 'last_price_update_time': 1777277618.429976, 'has_photos': True, 'auction_closing_time': 1777390132.0}
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_58c65b3100e5d270ade2de4cd90a1783.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d92e10>
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_58c65b3100e5d270ade2de4cd90a1783.jpg saved to cache
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_17d0b7a16c4597b8781393ed2c18e55f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH46995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049250>
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_17d0b7a16c4597b8781393ed2c18e55f.jpg saved to cache
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_2d4afa06a30a6437cf917d2e77fc90b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b6cde8b240b9bee39d4f67a5f0cb0ad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1dc10>
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_2d4afa06a30a6437cf917d2e77fc90b3.jpg saved to cache
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_53ccd6510ca49ff376b54936864905bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcff90>
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b6cde8b240b9bee39d4f67a5f0cb0ad3.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceb4d0>
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_53ccd6510ca49ff376b54936864905bb.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_6616265f1c9b1986b1fecc059290baa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d2fd0>
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_6616265f1c9b1986b1fecc059290baa9.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_45f84e40a5e850018ffec14c7612ccd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM30450> (referer: https://www.auto1.com/v1/car-details-view/CM30450/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_7255fadda2943e6a086848dd11a101e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd8790>
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_45f84e40a5e850018ffec14c7612ccd6.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_e4015df4b5666fb1bfbbe62e12585180.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-04-27 08:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 1
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_98023389f8eb83d92db3d21badd3e5f0.jpg not downloaded yet
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b06f10>
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_7255fadda2943e6a086848dd11a101e3.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_aeae82bf58fb7693d88d1a904878e52d.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_de27ed4c46f4c96cdeb36fcb5da13ab5.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_f44575cba4f517c60aac1da3f94ab8ad.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_121981d131b0415c7ac256ce916712ab.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_22219694fd406d10062774d7ccaa642c.jpg not downloaded yet
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cec850>
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_e4015df4b5666fb1bfbbe62e12585180.jpg saved to cache
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30
2026-04-27 08:13:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeaa479d-1f01-53e5-a2bc-c73c9779fd30, skipping ID generation
2026-04-27 08:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with scrape type 1
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeaa479d-1f01-53e5-a2bc-c73c9779fd30 sending to next pipeline
2026-04-27 08:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeaa479d-1f01-53e5-a2bc-c73c9779fd30, identifier: GJ97454
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_bf71ad1b6186e3c2c6ed9deedcdd326d.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with identifier: GJ97454
2026-04-27 08:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with identifier: GJ97454
2026-04-27 08:13:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeaa479d-1f01-53e5-a2bc-c73c9779fd30 with identifier: GJ97454 to the API
2026-04-27 08:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_e4015df4b5666fb1bfbbe62e12585180.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'city': 'Düsseldorf',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:37:00Z',
 'fuel_type': 'petrol',
 'id': 'aeaa479d-1f01-53e5-a2bc-c73c9779fd30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.2216,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ97454',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'location_confidence': 'geocoded',
 'longitude': 6.7897,
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_7255fadda2943e6a086848dd11a101e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_e4015df4b5666fb1bfbbe62e12585180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_45f84e40a5e850018ffec14c7612ccd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_6616265f1c9b1986b1fecc059290baa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_53ccd6510ca49ff376b54936864905bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b6cde8b240b9bee39d4f67a5f0cb0ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_2d4afa06a30a6437cf917d2e77fc90b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_17d0b7a16c4597b8781393ed2c18e55f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_58c65b3100e5d270ade2de4cd90a1783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aeaa479d-1f01-53e5-a2bc-c73c9779fd30/aeaa479d-1f01-53e5-a2bc-c73c9779fd30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/84/a884b18bb55c5047d61652c52f1857bb/pa/GJ97454_b68527605d268a9d266b35f213c22e79.jpg',
             'Width': 800}],
 'postal_code': '40210',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Düsseldorf',
 'province_code': 'DE-051',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2014-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI CrossPolo BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Cross BlueMotion Tech',
 'year': 2014}
2026-04-27 08:13:40 [auto1.de] INFO: Saving data for GJ97454: {'created_time': 1777277620.12653, 'last_price_update_time': 1777277620.126542, 'has_photos': True, 'auction_closing_time': 1777390620.0}
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_28e297f4e125bb82fe0c9110a4d5ea7a.jpg not downloaded yet
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_8505a5f10c625d3f2f82023fe4bb49b7.jpg not downloaded yet
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_c4c8c6ca76ab8ae20346dd7eea05fe9f.jpg not downloaded yet
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN73895> (referer: https://www.auto1.com/v1/car-details-view/ZN73895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-04-27 08:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 1
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b255b3dae2568d22504d20ac9466b0eb.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_8bb215022beb56bd16622539fb9a4370.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_764b2f5c9a6d2da1a586843bd868e94e.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d21a4083ef7cafaeb67bdf95849a27f8.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_5001fa3fce1813dec6846a225f584eca.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_20aaac5c2f8559b5d844018d6d2a19f6.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d5e292eddf3f6b36e42c402a3b373162.jpg not downloaded yet
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_c4c8c6ca76ab8ae20346dd7eea05fe9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d59692ea15dc583e97ff68bc60b7b343.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_67da60d6effd1fa453335af36e89ea62.jpg not downloaded yet
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b19ef4cf7bf108d6ee96f645a4fd5286.jpg not downloaded yet
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b07cd0>
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_c4c8c6ca76ab8ae20346dd7eea05fe9f.jpg saved to cache
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d5e292eddf3f6b36e42c402a3b373162.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22dcc8d0>
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d5e292eddf3f6b36e42c402a3b373162.jpg saved to cache
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b19ef4cf7bf108d6ee96f645a4fd5286.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b05710>
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b19ef4cf7bf108d6ee96f645a4fd5286.jpg saved to cache
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_67da60d6effd1fa453335af36e89ea62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67790>
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_67da60d6effd1fa453335af36e89ea62.jpg saved to cache
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d59692ea15dc583e97ff68bc60b7b343.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f47910>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d59692ea15dc583e97ff68bc60b7b343.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_20aaac5c2f8559b5d844018d6d2a19f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU20217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f68c50>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_20aaac5c2f8559b5d844018d6d2a19f6.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d21a4083ef7cafaeb67bdf95849a27f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_5001fa3fce1813dec6846a225f584eca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67750>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d21a4083ef7cafaeb67bdf95849a27f8.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f7210>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_5001fa3fce1813dec6846a225f584eca.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_764b2f5c9a6d2da1a586843bd868e94e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cee350>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_764b2f5c9a6d2da1a586843bd868e94e.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_8bb215022beb56bd16622539fb9a4370.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b255b3dae2568d22504d20ac9466b0eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5590>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_8bb215022beb56bd16622539fb9a4370.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceff50>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b255b3dae2568d22504d20ac9466b0eb.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdf748ad-260c-52e1-afb0-701034a3a560
2026-04-27 08:13:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdf748ad-260c-52e1-afb0-701034a3a560, skipping ID generation
2026-04-27 08:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 1
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdf748ad-260c-52e1-afb0-701034a3a560 sending to next pipeline
2026-04-27 08:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf748ad-260c-52e1-afb0-701034a3a560, identifier: ZN73895
2026-04-27 08:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-04-27 08:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-04-27 08:13:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895 to the API
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b255b3dae2568d22504d20ac9466b0eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'city': 'Schkopau',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:00:46Z',
 'fuel_type': 'diesel',
 'id': 'bdf748ad-260c-52e1-afb0-701034a3a560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN73895',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 78681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b255b3dae2568d22504d20ac9466b0eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_8bb215022beb56bd16622539fb9a4370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_764b2f5c9a6d2da1a586843bd868e94e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d21a4083ef7cafaeb67bdf95849a27f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_5001fa3fce1813dec6846a225f584eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_20aaac5c2f8559b5d844018d6d2a19f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d5e292eddf3f6b36e42c402a3b373162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_d59692ea15dc583e97ff68bc60b7b343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_67da60d6effd1fa453335af36e89ea62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bdf748ad-260c-52e1-afb0-701034a3a560/bdf748ad-260c-52e1-afb0-701034a3a560_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/f2/44f2b739373bbab5ebd080f94a32ecaf/pa/ZN73895_b19ef4cf7bf108d6ee96f645a4fd5286.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2016-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-04-27 08:13:43 [auto1.de] INFO: Saving data for ZN73895: {'created_time': 1777277623.360597, 'last_price_update_time': 1777277623.360607, 'has_photos': True, 'auction_closing_time': 1777388446.0}
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_8505a5f10c625d3f2f82023fe4bb49b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV94490> (referer: https://www.auto1.com/v1/car-details-view/EV94490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eab950>
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_8505a5f10c625d3f2f82023fe4bb49b7.jpg saved to cache
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with identifier: EV94490
2026-04-27 08:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with scrape type 1
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_21f60dcf557a88d6e9a12b48a59bd4fe.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c8c0c26b02d5c060813a4bb2f7825b66.jpg not downloaded yet
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_28e297f4e125bb82fe0c9110a4d5ea7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_f29bc0fec13618906384b7be4a1c4fcc.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d380d103a4a68535d2fe0aba1ac5ef04.jpg not downloaded yet
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_bf71ad1b6186e3c2c6ed9deedcdd326d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_36a0e48547250757feb3c09cc3045f33.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_2ce2eaa4a0ce8e0cc041e9b22a0a637e.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c75c4e27b896d7376cd9d0b59ed372d6.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d97f07e3fc6bc8e6a0bbdda5d8e10089.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_5776bb266463d2ce199b106dd98e5720.jpg not downloaded yet
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_72d026dbb8bc2d946a5fdf75f3e0a498.jpg not downloaded yet
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a71510>
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_28e297f4e125bb82fe0c9110a4d5ea7a.jpg saved to cache
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ff91d0>
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_bf71ad1b6186e3c2c6ed9deedcdd326d.jpg saved to cache
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c8c0c26b02d5c060813a4bb2f7825b66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [scrapy.extensions.logstats] INFO: Crawled 712 pages (at 20 pages/min), scraped 320 items (at 7 items/min)
2026-04-27 08:13:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d380d103a4a68535d2fe0aba1ac5ef04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef8d90>
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c8c0c26b02d5c060813a4bb2f7825b66.jpg saved to cache
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_72d026dbb8bc2d946a5fdf75f3e0a498.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1e810>
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d380d103a4a68535d2fe0aba1ac5ef04.jpg saved to cache
2026-04-27 08:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_5776bb266463d2ce199b106dd98e5720.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003dad0>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_72d026dbb8bc2d946a5fdf75f3e0a498.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ef9110>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_5776bb266463d2ce199b106dd98e5720.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d97f07e3fc6bc8e6a0bbdda5d8e10089.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c75c4e27b896d7376cd9d0b59ed372d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ddd0>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d97f07e3fc6bc8e6a0bbdda5d8e10089.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_2ce2eaa4a0ce8e0cc041e9b22a0a637e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce2c90>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c75c4e27b896d7376cd9d0b59ed372d6.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003d510>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_2ce2eaa4a0ce8e0cc041e9b22a0a637e.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_36a0e48547250757feb3c09cc3045f33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_f29bc0fec13618906384b7be4a1c4fcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_21f60dcf557a88d6e9a12b48a59bd4fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a34f90>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_36a0e48547250757feb3c09cc3045f33.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c610>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_f29bc0fec13618906384b7be4a1c4fcc.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e21710>
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_21f60dcf557a88d6e9a12b48a59bd4fe.jpg saved to cache
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f
2026-04-27 08:13:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f, skipping ID generation
2026-04-27 08:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with scrape type 1
2026-04-27 08:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f sending to next pipeline
2026-04-27 08:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f, identifier: EV94490
2026-04-27 08:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with identifier: EV94490
2026-04-27 08:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with identifier: EV94490
2026-04-27 08:13:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f with identifier: EV94490 to the API
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_21f60dcf557a88d6e9a12b48a59bd4fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Fockbek',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:18:47Z',
 'fuel_type': 'diesel',
 'id': 'a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 54.3,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV94490',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'location_confidence': 'geocoded',
 'longitude': 9.6,
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 130276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_21f60dcf557a88d6e9a12b48a59bd4fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c8c0c26b02d5c060813a4bb2f7825b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_f29bc0fec13618906384b7be4a1c4fcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d380d103a4a68535d2fe0aba1ac5ef04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_36a0e48547250757feb3c09cc3045f33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_2ce2eaa4a0ce8e0cc041e9b22a0a637e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_c75c4e27b896d7376cd9d0b59ed372d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_d97f07e3fc6bc8e6a0bbdda5d8e10089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_5776bb266463d2ce199b106dd98e5720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f/a3cd1031-ebbd-5a20-a0b5-f3ccc4222e7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/73/a073b472f798060bf0909e361d3b4a2f/pa/EV94490_72d026dbb8bc2d946a5fdf75f3e0a498.jpg',
             'Width': 800}],
 'postal_code': '24787',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-04-27 08:13:45 [auto1.de] INFO: Saving data for EV94490: {'created_time': 1777277625.356434, 'last_price_update_time': 1777277625.356445, 'has_photos': True, 'auction_closing_time': 1777389527.0}
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_121981d131b0415c7ac256ce916712ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_22219694fd406d10062774d7ccaa642c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce1d10>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_121981d131b0415c7ac256ce916712ab.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30090390>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_22219694fd406d10062774d7ccaa642c.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_de27ed4c46f4c96cdeb36fcb5da13ab5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_f44575cba4f517c60aac1da3f94ab8ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_98023389f8eb83d92db3d21badd3e5f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaab10>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_de27ed4c46f4c96cdeb36fcb5da13ab5.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_405ff84bbd887c22cfac0600c91e185e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a37790>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_f44575cba4f517c60aac1da3f94ab8ad.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30093010>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_98023389f8eb83d92db3d21badd3e5f0.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_aeae82bf58fb7693d88d1a904878e52d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30159650>
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_405ff84bbd887c22cfac0600c91e185e.jpg saved to cache
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47694292-d2b5-5131-b2af-5e58dedf696d
2026-04-27 08:13:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47694292-d2b5-5131-b2af-5e58dedf696d, skipping ID generation
2026-04-27 08:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47694292-d2b5-5131-b2af-5e58dedf696d with scrape type 1
2026-04-27 08:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47694292-d2b5-5131-b2af-5e58dedf696d sending to next pipeline
2026-04-27 08:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47694292-d2b5-5131-b2af-5e58dedf696d, identifier: LY70267
2026-04-27 08:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47694292-d2b5-5131-b2af-5e58dedf696d with identifier: LY70267
2026-04-27 08:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47694292-d2b5-5131-b2af-5e58dedf696d with identifier: LY70267
2026-04-27 08:13:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47694292-d2b5-5131-b2af-5e58dedf696d with identifier: LY70267 to the API
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_405ff84bbd887c22cfac0600c91e185e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-04-28T15:09:22Z',
 'fuel_type': 'petrol',
 'id': '47694292-d2b5-5131-b2af-5e58dedf696d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY70267',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 145521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_405ff84bbd887c22cfac0600c91e185e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_6181762b0a16f7a854c79fc6e80ba263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0d92fc33024cf66ab32a44bc6647903a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_0226a3d34578653dd50ae5da3bc9146e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_47694292-d2b5-5131-b2af-5e58dedf696d/47694292-d2b5-5131-b2af-5e58dedf696d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/52/115260dc5295bb822335ff14a9a9a34f/pa/LY70267_751fa9ed6b58d800dab46bd0937989dd.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2009-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-04-27 08:13:46 [auto1.de] INFO: Saving data for LY70267: {'created_time': 1777277626.278569, 'last_price_update_time': 1777277626.278579, 'has_photos': True, 'auction_closing_time': 1777388962.0}
2026-04-27 08:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30048e90>
2026-04-27 08:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_aeae82bf58fb7693d88d1a904878e52d.jpg saved to cache
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db2e181e-743a-5f4b-9171-9e0ec8f50619
2026-04-27 08:13:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db2e181e-743a-5f4b-9171-9e0ec8f50619, skipping ID generation
2026-04-27 08:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 1
2026-04-27 08:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db2e181e-743a-5f4b-9171-9e0ec8f50619 sending to next pipeline
2026-04-27 08:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2e181e-743a-5f4b-9171-9e0ec8f50619, identifier: CM30450
2026-04-27 08:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-04-27 08:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-04-27 08:13:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450 to the API
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_aeae82bf58fb7693d88d1a904878e52d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'city': 'Zülpich',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-04-28T15:14:52Z',
 'fuel_type': 'diesel',
 'id': 'db2e181e-743a-5f4b-9171-9e0ec8f50619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM30450',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 156152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_98023389f8eb83d92db3d21badd3e5f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_aeae82bf58fb7693d88d1a904878e52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_de27ed4c46f4c96cdeb36fcb5da13ab5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_f44575cba4f517c60aac1da3f94ab8ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_121981d131b0415c7ac256ce916712ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_22219694fd406d10062774d7ccaa642c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_bf71ad1b6186e3c2c6ed9deedcdd326d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_28e297f4e125bb82fe0c9110a4d5ea7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_8505a5f10c625d3f2f82023fe4bb49b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_db2e181e-743a-5f4b-9171-9e0ec8f50619/db2e181e-743a-5f4b-9171-9e0ec8f50619_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c5/ffc5239f0f2e8aae5fd80e0beb2266f9/pa/CM30450_c4c8c6ca76ab8ae20346dd7eea05fe9f.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-04-27 08:13:46 [auto1.de] INFO: Saving data for CM30450: {'created_time': 1777277626.707349, 'last_price_update_time': 1777277626.707358, 'has_photos': True, 'auction_closing_time': 1777389292.0}
2026-04-27 08:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:50 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 10691 | hits on page: 40
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: HY59950
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for HY59950: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: YD46816
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for YD46816: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: WA27160
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for WA27160: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: AC93351
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for AC93351: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: SF40238
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for SF40238: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: EU16330
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for EU16330: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: UH98030
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for UH98030: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: DU24900
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for DU24900: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: YB31045
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for YB31045: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: DY50654
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for DY50654: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: JA61981
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for JA61981: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: TN90978
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for TN90978: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: LW31172
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for LW31172: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: KV63005
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for KV63005: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: RT17633
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for RT17633: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: FZ44341
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for FZ44341: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: WM92203
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for WM92203: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: GA34239
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for GA34239: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: MT63748
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for MT63748: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: FJ76970
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for FJ76970: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: KU48054
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for KU48054: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: NG95933
2026-04-27 08:13:50 [auto1.de] INFO: Scrape type for NG95933: 1
2026-04-27 08:13:50 [auto1.de] INFO: Found listing with ID: VG14564
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for VG14564: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: JB74437
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for JB74437: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: VV56220
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for VV56220: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: UB07132
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for UB07132: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: KJ12207
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for KJ12207: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: NS14659
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for NS14659: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: EY91378
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for EY91378: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: LJ19691
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for LJ19691: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: PK35739
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for PK35739: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: YR53250
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for YR53250: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: WC91359
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for WC91359: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: PT52067
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for PT52067: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: FT52767
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for FT52767: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: LL59024
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for LL59024: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: CL76993
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for CL76993: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: DM81124
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for DM81124: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: XA71760
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for XA71760: 1
2026-04-27 08:13:51 [auto1.de] INFO: Found listing with ID: NX12512
2026-04-27 08:13:51 [auto1.de] INFO: Scrape type for NX12512: 1
2026-04-27 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV45977> (referer: https://www.auto1.com/v1/car-details-view/BV45977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS92375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2e3662-2a66-58da-87e5-1889f725c1da with identifier: BV45977
2026-04-27 08:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2e3662-2a66-58da-87e5-1889f725c1da with scrape type 1
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_6ed9dc1a694a00ea8bd8202b8ab7472a.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_ffa3de6212b1bfe46265f7cb5a3267fb.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_3075a5b34d671c2dba68a05362f3b609.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_b997a2c5c242b281529b600087e084c4.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_cb2310baf3bd1956d02552ee5cb57492.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_d16ed430af2d0bd9a725bcb822ac56f9.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_1a4b8e2ebbc1885ee23159540eda4aca.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_fa7948378a3f0ac68060e47ccfce6130.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_f61bb7ac23d19aac71310fc77c56f128.jpg not downloaded yet
2026-04-27 08:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_daa4cfbb49ddefd6c47acf93bdef0b33.jpg not downloaded yet
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG46200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_daa4cfbb49ddefd6c47acf93bdef0b33.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP40220> (referer: https://www.auto1.com/v1/car-details-view/KP40220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5e90>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_daa4cfbb49ddefd6c47acf93bdef0b33.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_f61bb7ac23d19aac71310fc77c56f128.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-04-27 08:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53f1954-c75e-59c3-9f7f-342f3f18c076 with scrape type 1
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg not downloaded yet
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_fa7948378a3f0ac68060e47ccfce6130.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg not downloaded yet
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f0d110>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_f61bb7ac23d19aac71310fc77c56f128.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg not downloaded yet
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg not downloaded yet
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9d610>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_fa7948378a3f0ac68060e47ccfce6130.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg not downloaded yet
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da3650>
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg saved to cache
2026-04-27 08:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b9450>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1e050>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ea8750>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da2510>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003da10>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG32148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a21c50>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a20590>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cae4d0>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a1c850>
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg saved to cache
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-04-27 08:13:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a53f1954-c75e-59c3-9f7f-342f3f18c076, skipping ID generation
2026-04-27 08:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53f1954-c75e-59c3-9f7f-342f3f18c076 with scrape type 1
2026-04-27 08:13:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a53f1954-c75e-59c3-9f7f-342f3f18c076 sending to next pipeline
2026-04-27 08:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53f1954-c75e-59c3-9f7f-342f3f18c076, identifier: KP40220
2026-04-27 08:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-04-27 08:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-04-27 08:13:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220 to the API
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'city': 'Hodenhagen',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-04-28T15:33:26Z',
 'fuel_type': 'petrol',
 'id': 'a53f1954-c75e-59c3-9f7f-342f3f18c076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.7651,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP40220',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'location_confidence': 'geocoded',
 'longitude': 9.5949,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 84135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg',
             'Width': 800}],
 'postal_code': '29693',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2013-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-04-27 08:13:55 [auto1.de] INFO: Saving data for KP40220: {'created_time': 1777277635.249054, 'last_price_update_time': 1777277635.249065, 'has_photos': True, 'auction_closing_time': 1777390406.0}
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_1a4b8e2ebbc1885ee23159540eda4aca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_d16ed430af2d0bd9a725bcb822ac56f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH46995> (referer: https://www.auto1.com/v1/car-details-view/AH46995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da1690>
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_1a4b8e2ebbc1885ee23159540eda4aca.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e2c10>
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_d16ed430af2d0bd9a725bcb822ac56f9.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with identifier: AH46995
2026-04-27 08:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with scrape type 1
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_7367602721eba783e9935aec8487ade9.jpg not downloaded yet
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_cb2310baf3bd1956d02552ee5cb57492.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9174c42c2897aeca8e18fed3452eb209.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9e2edd3f6ba076e8e84bc9b9803fc1ad.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_0fff4c3e32b2875b3446fcb2373f9804.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_4b3411e6f40665218ba2c0e9e11715bb.jpg not downloaded yet
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003f4d0>
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_cb2310baf3bd1956d02552ee5cb57492.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_7367602721eba783e9935aec8487ade9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003ee50>
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_7367602721eba783e9935aec8487ade9.jpg saved to cache
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_4b3411e6f40665218ba2c0e9e11715bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300bab50>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_4b3411e6f40665218ba2c0e9e11715bb.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_0fff4c3e32b2875b3446fcb2373f9804.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003fc50>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_0fff4c3e32b2875b3446fcb2373f9804.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9e2edd3f6ba076e8e84bc9b9803fc1ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b86010>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9e2edd3f6ba076e8e84bc9b9803fc1ad.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9174c42c2897aeca8e18fed3452eb209.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED13433> (referer: https://www.auto1.com/v1/car-details-view/ED13433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9db50>
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9174c42c2897aeca8e18fed3452eb209.jpg saved to cache
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8
2026-04-27 08:13:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d11f1f7-b822-52a9-b707-30bf8a3befb8, skipping ID generation
2026-04-27 08:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with scrape type 1
2026-04-27 08:13:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d11f1f7-b822-52a9-b707-30bf8a3befb8 sending to next pipeline
2026-04-27 08:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d11f1f7-b822-52a9-b707-30bf8a3befb8, identifier: AH46995
2026-04-27 08:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with identifier: AH46995
2026-04-27 08:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with identifier: AH46995
2026-04-27 08:13:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d11f1f7-b822-52a9-b707-30bf8a3befb8 with identifier: AH46995 to the API
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9174c42c2897aeca8e18fed3452eb209.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'city': 'Zülpich',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:46:29Z',
 'fuel_type': 'petrol',
 'id': '0d11f1f7-b822-52a9-b707-30bf8a3befb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.7,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH46995',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'location_confidence': 'geocoded',
 'longitude': 6.65,
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 275479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_7367602721eba783e9935aec8487ade9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9174c42c2897aeca8e18fed3452eb209.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_9e2edd3f6ba076e8e84bc9b9803fc1ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_0fff4c3e32b2875b3446fcb2373f9804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d11f1f7-b822-52a9-b707-30bf8a3befb8/0d11f1f7-b822-52a9-b707-30bf8a3befb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/03/3e03f996eb35bc01ea204cbdf7ea4a51/pa/AH46995_4b3411e6f40665218ba2c0e9e11715bb.jpg',
             'Width': 800}],
 'postal_code': '53909',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2001-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2001}
2026-04-27 08:13:57 [auto1.de] INFO: Saving data for AH46995: {'created_time': 1777277637.087636, 'last_price_update_time': 1777277637.087646, 'has_photos': True, 'auction_closing_time': 1777391189.0}
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_b997a2c5c242b281529b600087e084c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_3075a5b34d671c2dba68a05362f3b609.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with identifier: ED13433
2026-04-27 08:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with scrape type 1
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84188b93919d791aaeb816ab44971c68.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_a11cb6fa5db26beeee53076a6c442085.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_fb733f6ec46c599174937794aecf6052.jpg not downloaded yet
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_ffa3de6212b1bfe46265f7cb5a3267fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84b926f6551ff8be450175d1585a51bf.jpg not downloaded yet
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_6ed9dc1a694a00ea8bd8202b8ab7472a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_493198fc8445d6c197d88947276c8c42.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_9c26fdf662d261c2c80d0de3875837ef.jpg not downloaded yet
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3650>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_b997a2c5c242b281529b600087e084c4.jpg saved to cache
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f64a10>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_3075a5b34d671c2dba68a05362f3b609.jpg saved to cache
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_d16409e855740a773bdd56221a76700e.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_33a082594906c212760182d703156fc3.jpg not downloaded yet
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2b4d0>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_ffa3de6212b1bfe46265f7cb5a3267fb.jpg saved to cache
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302889d0>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_6ed9dc1a694a00ea8bd8202b8ab7472a.jpg saved to cache
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb2e3662-2a66-58da-87e5-1889f725c1da
2026-04-27 08:13:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb2e3662-2a66-58da-87e5-1889f725c1da, skipping ID generation
2026-04-27 08:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2e3662-2a66-58da-87e5-1889f725c1da with scrape type 1
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb2e3662-2a66-58da-87e5-1889f725c1da sending to next pipeline
2026-04-27 08:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2e3662-2a66-58da-87e5-1889f725c1da, identifier: BV45977
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f0aa70041b709eb322d188aa6a79c13d.jpg not downloaded yet
2026-04-27 08:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2e3662-2a66-58da-87e5-1889f725c1da with identifier: BV45977
2026-04-27 08:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2e3662-2a66-58da-87e5-1889f725c1da with identifier: BV45977
2026-04-27 08:13:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2e3662-2a66-58da-87e5-1889f725c1da with identifier: BV45977 to the API
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_6ed9dc1a694a00ea8bd8202b8ab7472a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'city': 'Karlskron',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 182,
 'expiration_date': '2026-04-28T15:25:54Z',
 'fuel_type': 'petrol',
 'id': 'fb2e3662-2a66-58da-87e5-1889f725c1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV45977',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 155809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_6ed9dc1a694a00ea8bd8202b8ab7472a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_ffa3de6212b1bfe46265f7cb5a3267fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_3075a5b34d671c2dba68a05362f3b609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_b997a2c5c242b281529b600087e084c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_cb2310baf3bd1956d02552ee5cb57492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_d16ed430af2d0bd9a725bcb822ac56f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_1a4b8e2ebbc1885ee23159540eda4aca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_fa7948378a3f0ac68060e47ccfce6130.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_f61bb7ac23d19aac71310fc77c56f128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb2e3662-2a66-58da-87e5-1889f725c1da/fb2e3662-2a66-58da-87e5-1889f725c1da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/16/7a16950f8a8ef59b7d5b97502d17206c/pa/BV45977_daa4cfbb49ddefd6c47acf93bdef0b33.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-04-27 08:13:57 [auto1.de] INFO: Saving data for BV45977: {'created_time': 1777277637.855739, 'last_price_update_time': 1777277637.855748, 'has_photos': True, 'auction_closing_time': 1777389954.0}
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_a11cb6fa5db26beeee53076a6c442085.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_fb733f6ec46c599174937794aecf6052.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f6497fcf96c08386d8685370051b9de9.jpg not downloaded yet
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e41090>
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_a11cb6fa5db26beeee53076a6c442085.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c350>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_fb733f6ec46c599174937794aecf6052.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_33a082594906c212760182d703156fc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f0aa70041b709eb322d188aa6a79c13d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd2f50>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_33a082594906c212760182d703156fc3.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f1ead0>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f0aa70041b709eb322d188aa6a79c13d.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_d16409e855740a773bdd56221a76700e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f6497fcf96c08386d8685370051b9de9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e0090>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_d16409e855740a773bdd56221a76700e.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e3d90>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f6497fcf96c08386d8685370051b9de9.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_9c26fdf662d261c2c80d0de3875837ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_493198fc8445d6c197d88947276c8c42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad390>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_9c26fdf662d261c2c80d0de3875837ef.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84188b93919d791aaeb816ab44971c68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300ad790>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_493198fc8445d6c197d88947276c8c42.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84b926f6551ff8be450175d1585a51bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300af050>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84188b93919d791aaeb816ab44971c68.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9c9d0>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84b926f6551ff8be450175d1585a51bf.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5
2026-04-27 08:13:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5, skipping ID generation
2026-04-27 08:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with scrape type 1
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 sending to next pipeline
2026-04-27 08:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5, identifier: ED13433
2026-04-27 08:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with identifier: ED13433
2026-04-27 08:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with identifier: ED13433
2026-04-27 08:13:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b6a078f-c1c5-5e9d-82ce-5c13504d35d5 with identifier: ED13433 to the API
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84b926f6551ff8be450175d1585a51bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'city': 'Ketzin',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-04-28T15:01:02Z',
 'fuel_type': 'diesel',
 'id': '4b6a078f-c1c5-5e9d-82ce-5c13504d35d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.4781,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED13433',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'location_confidence': 'geocoded',
 'longitude': 12.8453,
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 55763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84188b93919d791aaeb816ab44971c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_a11cb6fa5db26beeee53076a6c442085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_fb733f6ec46c599174937794aecf6052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_84b926f6551ff8be450175d1585a51bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_493198fc8445d6c197d88947276c8c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_9c26fdf662d261c2c80d0de3875837ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_d16409e855740a773bdd56221a76700e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_33a082594906c212760182d703156fc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f0aa70041b709eb322d188aa6a79c13d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4b6a078f-c1c5-5e9d-82ce-5c13504d35d5/4b6a078f-c1c5-5e9d-82ce-5c13504d35d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/54/2454c0090e13f8c2ec1e7593745804b1/pa/ED13433_f6497fcf96c08386d8685370051b9de9.jpg',
             'Width': 800}],
 'postal_code': '14669',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2020}
2026-04-27 08:13:59 [auto1.de] INFO: Saving data for ED13433: {'created_time': 1777277639.284364, 'last_price_update_time': 1777277639.284375, 'has_photos': True, 'auction_closing_time': 1777388462.0}
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU20217> (referer: https://www.auto1.com/v1/car-details-view/RU20217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-04-27 08:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f144c24-ac52-56f4-99d0-a2a97518fae2 with scrape type 1
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_12138c2a4f59860594db3fca13374afe.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_2dbc129ffb9e98c6c0ae450f4e8b4036.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_b4c43a1ede8919a049448a7ce957176d.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_96839fdc49d9d979b4c1985e3525668d.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_76f762fc683af7895e4b07967c74b055.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_9b9e574978f11711e742d57db25e84e5.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c8ba79966267c017aeec2063c8b61c1b.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_d73fb40cc024d230f6abb3f01c9b4a6e.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c7f01363b8070e265ea8d94235a89f72.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_08b95dd1581d3f52f3e7b2462a47d467.jpg not downloaded yet
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL62048/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_08b95dd1581d3f52f3e7b2462a47d467.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX24821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad610>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_08b95dd1581d3f52f3e7b2462a47d467.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c7f01363b8070e265ea8d94235a89f72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40790>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c7f01363b8070e265ea8d94235a89f72.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE55796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_d73fb40cc024d230f6abb3f01c9b4a6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a710>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_d73fb40cc024d230f6abb3f01c9b4a6e.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.783(s), this was the 1st time calling it.
2026-04-27 08:14:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.578337602991227 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX12512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c8ba79966267c017aeec2063c8b61c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce3b50>
2026-04-27 08:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c8ba79966267c017aeec2063c8b61c1b.jpg saved to cache
2026-04-27 08:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA71760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_9b9e574978f11711e742d57db25e84e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb09d0>
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_9b9e574978f11711e742d57db25e84e5.jpg saved to cache
2026-04-27 08:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC77974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_76f762fc683af7895e4b07967c74b055.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3015a8d0>
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_76f762fc683af7895e4b07967c74b055.jpg saved to cache
2026-04-27 08:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM81124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL59666> (referer: https://www.auto1.com/v1/car-details-view/NL59666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_96839fdc49d9d979b4c1985e3525668d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-04-27 08:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 1
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg not downloaded yet
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c9e50>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_96839fdc49d9d979b4c1985e3525668d.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg not downloaded yet
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_b4c43a1ede8919a049448a7ce957176d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg not downloaded yet
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg not downloaded yet
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003f750>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_b4c43a1ede8919a049448a7ce957176d.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300a3510>
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg saved to cache
2026-04-27 08:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba7c10>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f69e10>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba50d0>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH70383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30158890>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43490>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b9d710>
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg saved to cache
2026-04-27 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4d90>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8d950>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d4ed0>
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg saved to cache
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-04-27 08:14:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4466ed50-5955-5583-a8aa-05d304311dea, skipping ID generation
2026-04-27 08:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 1
2026-04-27 08:14:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4466ed50-5955-5583-a8aa-05d304311dea sending to next pipeline
2026-04-27 08:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4466ed50-5955-5583-a8aa-05d304311dea, identifier: NL59666
2026-04-27 08:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-04-27 08:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-04-27 08:14:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666 to the API
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'city': 'Karlskron',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '4466ed50-5955-5583-a8aa-05d304311dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL59666',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 286049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2016-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2016}
2026-04-27 08:14:29 [auto1.de] INFO: Saving data for NL59666: {'created_time': 1777277669.28242, 'last_price_update_time': 1777277669.28243, 'has_photos': True, 'auction_closing_time': 1777390073.0}
2026-04-27 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_2dbc129ffb9e98c6c0ae450f4e8b4036.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_12138c2a4f59860594db3fca13374afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003f690>
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_2dbc129ffb9e98c6c0ae450f4e8b4036.jpg saved to cache
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d90b90>
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_12138c2a4f59860594db3fca13374afe.jpg saved to cache
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f144c24-ac52-56f4-99d0-a2a97518fae2
2026-04-27 08:14:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f144c24-ac52-56f4-99d0-a2a97518fae2, skipping ID generation
2026-04-27 08:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f144c24-ac52-56f4-99d0-a2a97518fae2 with scrape type 1
2026-04-27 08:14:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f144c24-ac52-56f4-99d0-a2a97518fae2 sending to next pipeline
2026-04-27 08:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f144c24-ac52-56f4-99d0-a2a97518fae2, identifier: RU20217
2026-04-27 08:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-04-27 08:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-04-27 08:14:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217 to the API
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_12138c2a4f59860594db3fca13374afe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'city': 'Dortmund',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-04-28T15:15:17Z',
 'fuel_type': 'petrol',
 'id': '7f144c24-ac52-56f4-99d0-a2a97518fae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU20217',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 82993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_12138c2a4f59860594db3fca13374afe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_2dbc129ffb9e98c6c0ae450f4e8b4036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_b4c43a1ede8919a049448a7ce957176d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_96839fdc49d9d979b4c1985e3525668d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_76f762fc683af7895e4b07967c74b055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_9b9e574978f11711e742d57db25e84e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c8ba79966267c017aeec2063c8b61c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_d73fb40cc024d230f6abb3f01c9b4a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_c7f01363b8070e265ea8d94235a89f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f144c24-ac52-56f4-99d0-a2a97518fae2/7f144c24-ac52-56f4-99d0-a2a97518fae2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/88/ff88c385da5f5c70f842c072e306626d/pa/RU20217_08b95dd1581d3f52f3e7b2462a47d467.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2018-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Selection Start/Stop',
 'transmission': 'manual',
 'trim': 'Selection Start/Stop',
 'year': 2018}
2026-04-27 08:14:29 [auto1.de] INFO: Saving data for RU20217: {'created_time': 1777277669.973473, 'last_price_update_time': 1777277669.973483, 'has_photos': True, 'auction_closing_time': 1777389317.0}
2026-04-27 08:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS92375> (referer: https://www.auto1.com/v1/car-details-view/KS92375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-04-27 08:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999a931d-383e-5c23-957a-44c188909021 with scrape type 1
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg not downloaded yet
2026-04-27 08:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg not downloaded yet
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG46200> (referer: https://www.auto1.com/v1/car-details-view/DG46200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-04-27 08:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 1
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg not downloaded yet
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg not downloaded yet
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg not downloaded yet
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301584d0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f1cd0>
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg saved to cache
2026-04-27 08:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a36b50>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0090>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE55796> (referer: https://www.auto1.com/v1/car-details-view/RE55796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-04-27 08:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38818c43-d29c-568d-a8ea-53e5abdab369 with scrape type 1
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg not downloaded yet
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30090550>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg not downloaded yet
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eaf20d0>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL62048> (referer: https://www.auto1.com/v1/car-details-view/FL62048/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce1710>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg saved to cache
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-04-27 08:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 1
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg not downloaded yet
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg not downloaded yet
2026-04-27 08:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg not downloaded yet
2026-04-27 08:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30055c10>
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg not downloaded yet
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg not downloaded yet
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed15d0>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg not downloaded yet
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30056d10>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg not downloaded yet
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30041c50>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300924d0>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f28210>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cd9510>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e22410>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX12512> (referer: https://www.auto1.com/v1/car-details-view/NX12512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cb1bd0>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30f4c190>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cae410>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_6511a250b00cd8d59fbbe7d1a7ce6fc9.jpg not downloaded yet
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_413c19f55ca951bae8802e1754944c1e.jpg not downloaded yet
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_375f028d3222990042ebd277d43788f0.jpg not downloaded yet
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG32148> (referer: https://www.auto1.com/v1/car-details-view/XG32148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_9e14cac62db191e3f77c5de0db0a8dca.jpg not downloaded yet
2026-04-27 08:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_82e97bf420d8042e92e6bbff5248b3c2.jpg not downloaded yet
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f28090>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb2e50>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_ba803fd3ee8d4409cd381a972d10a25d.jpg not downloaded yet
2026-04-27 08:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_6511a250b00cd8d59fbbe7d1a7ce6fc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_a9722af67d2a14a87212da05ac6053fc.jpg not downloaded yet
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b81090>
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg saved to cache
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-04-27 08:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3017df4-9d20-5512-8803-bf32bd7385e5, skipping ID generation
2026-04-27 08:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 1
2026-04-27 08:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3017df4-9d20-5512-8803-bf32bd7385e5 sending to next pipeline
2026-04-27 08:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3017df4-9d20-5512-8803-bf32bd7385e5, identifier: FL62048
2026-04-27 08:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3008400d-b191-52a5-8ebb-abb3e5a40e62 with identifier: XG32148
2026-04-27 08:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3008400d-b191-52a5-8ebb-abb3e5a40e62 with scrape type 1
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f9db48edd202ac4d59398b51b1a69953.jpg not downloaded yet
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300b8490>
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg saved to cache
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-04-27 08:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-04-27 08:14:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048 to the API
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': 'Rental',
 'city': 'Zörbig',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:33:16Z',
 'fuel_type': 'diesel',
 'id': 'c3017df4-9d20-5512-8803-bf32bd7385e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.6289,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL62048',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'location_confidence': 'geocoded',
 'longitude': 12.1174,
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg',
             'Width': 800}],
 'postal_code': '06780',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2016-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-04-27 08:14:36 [auto1.de] INFO: Saving data for FL62048: {'created_time': 1777277676.679855, 'last_price_update_time': 1777277676.679865, 'has_photos': True, 'auction_closing_time': 1777390396.0}
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_b39f4bc32beb4f3008d14c863de472b0.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_96b3af6348f2f1d210f657eb876fb6be.jpg not downloaded yet
2026-04-27 08:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_375f028d3222990042ebd277d43788f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_9e14cac62db191e3f77c5de0db0a8dca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a29b50>
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg saved to cache
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38818c43-d29c-568d-a8ea-53e5abdab369
2026-04-27 08:14:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38818c43-d29c-568d-a8ea-53e5abdab369, skipping ID generation
2026-04-27 08:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38818c43-d29c-568d-a8ea-53e5abdab369 with scrape type 1
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38818c43-d29c-568d-a8ea-53e5abdab369 sending to next pipeline
2026-04-27 08:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38818c43-d29c-568d-a8ea-53e5abdab369, identifier: RE55796
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3014e290>
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_6511a250b00cd8d59fbbe7d1a7ce6fc9.jpg saved to cache
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_c783439fef348881f89caa9ad9e663c0.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_062721999560a86fd0cc10dc72d852f7.jpg not downloaded yet
2026-04-27 08:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-04-27 08:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796
2026-04-27 08:14:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38818c43-d29c-568d-a8ea-53e5abdab369 with identifier: RE55796 to the API
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'city': 'Germersheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-04-28T15:40:50Z',
 'fuel_type': 'diesel',
 'id': '38818c43-d29c-568d-a8ea-53e5abdab369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE55796',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 234080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9463239778781874562c567f9cf107c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_bb5e32da729cd2376e7b8af62a793cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_9815c89dd689f463c1869781d84ee366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_3e26c303ce09b8691d1b419cb607adde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_b0d30e108eff6df8cfdd9d1aa189c1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_38818c43-d29c-568d-a8ea-53e5abdab369/38818c43-d29c-568d-a8ea-53e5abdab369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ac/58ac83d60c2e1328c95b48d4a722e72f/pa/RE55796_7dc8b81323836f66577d238175fe66b6.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2012-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 2.0 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-04-27 08:14:37 [auto1.de] INFO: Saving data for RE55796: {'created_time': 1777277677.24221, 'last_price_update_time': 1777277677.242222, 'has_photos': True, 'auction_closing_time': 1777390850.0}
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b5b250>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_ba803fd3ee8d4409cd381a972d10a25d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_82e97bf420d8042e92e6bbff5248b3c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_1d3efa25ce8d85c85a7f258e46b75635.jpg not downloaded yet
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_05f615f54f79506b0e053b55687744f4.jpg not downloaded yet
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b81190>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_375f028d3222990042ebd277d43788f0.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b862d0>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_9e14cac62db191e3f77c5de0db0a8dca.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f8268795bdf32f684374b86fdb9ff8bf.jpg not downloaded yet
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f9db48edd202ac4d59398b51b1a69953.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3007a190>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_ba803fd3ee8d4409cd381a972d10a25d.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018aa10>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_82e97bf420d8042e92e6bbff5248b3c2.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_e1ea77915ac0f33c7a379ac5a8d8d72d.jpg not downloaded yet
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_dbbf8245e9759d22dedc69f1a19f1a57.jpg not downloaded yet
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_a9722af67d2a14a87212da05ac6053fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_15d32f6bbc7888337a4bdda8fb831147.jpg not downloaded yet
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_4c71703ca40d0bfb0c3b6532836cb4e9.jpg not downloaded yet
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a11c90>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f9db48edd202ac4d59398b51b1a69953.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_91db8b4e56d06bfb647ba1e850ad7d78.jpg not downloaded yet
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_c783439fef348881f89caa9ad9e663c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_062721999560a86fd0cc10dc72d852f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ab0610>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_a9722af67d2a14a87212da05ac6053fc.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_05f615f54f79506b0e053b55687744f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003a710>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_c783439fef348881f89caa9ad9e663c0.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_dbbf8245e9759d22dedc69f1a19f1a57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_91db8b4e56d06bfb647ba1e850ad7d78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_4c71703ca40d0bfb0c3b6532836cb4e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22febd50>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_062721999560a86fd0cc10dc72d852f7.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ce0650>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_05f615f54f79506b0e053b55687744f4.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d512d0>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_dbbf8245e9759d22dedc69f1a19f1a57.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_15d32f6bbc7888337a4bdda8fb831147.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f8268795bdf32f684374b86fdb9ff8bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d7a890>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_91db8b4e56d06bfb647ba1e850ad7d78.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d53410>
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_4c71703ca40d0bfb0c3b6532836cb4e9.jpg saved to cache
2026-04-27 08:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_e1ea77915ac0f33c7a379ac5a8d8d72d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ffbe50>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_15d32f6bbc7888337a4bdda8fb831147.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_1d3efa25ce8d85c85a7f258e46b75635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7af150>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f8268795bdf32f684374b86fdb9ff8bf.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d78fd0>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_e1ea77915ac0f33c7a379ac5a8d8d72d.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_b39f4bc32beb4f3008d14c863de472b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049710>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_1d3efa25ce8d85c85a7f258e46b75635.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d390>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_b39f4bc32beb4f3008d14c863de472b0.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145
2026-04-27 08:14:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145, skipping ID generation
2026-04-27 08:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with scrape type 1
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 sending to next pipeline
2026-04-27 08:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145, identifier: NX12512
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ecd9510>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-04-27 08:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-04-27 08:14:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512 to the API
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_b39f4bc32beb4f3008d14c863de472b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'city': 'Dortmund',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-04-28T15:52:02Z',
 'fuel_type': 'diesel',
 'id': '8e518cf9-48cc-5d8c-9ee7-26ccbf51c145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX12512',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Audi',
 'model': 'A6',
 'odometer': 209234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_6511a250b00cd8d59fbbe7d1a7ce6fc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_375f028d3222990042ebd277d43788f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_9e14cac62db191e3f77c5de0db0a8dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_82e97bf420d8042e92e6bbff5248b3c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_ba803fd3ee8d4409cd381a972d10a25d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_a9722af67d2a14a87212da05ac6053fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_b39f4bc32beb4f3008d14c863de472b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_c783439fef348881f89caa9ad9e663c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e518cf9-48cc-5d8c-9ee7-26ccbf51c145/8e518cf9-48cc-5d8c-9ee7-26ccbf51c145_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/83/ed836ffa740265477b4803eb17fb0f75/pa/NX12512_1d3efa25ce8d85c85a7f258e46b75635.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2013-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-04-27 08:14:38 [auto1.de] INFO: Saving data for NX12512: {'created_time': 1777277678.868761, 'last_price_update_time': 1777277678.868771, 'has_photos': True, 'auction_closing_time': 1777391522.0}
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d32089010>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fe8b10>
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg saved to cache
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-04-27 08:14:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9a72b18-588d-5085-b89f-6448e85a5c91, skipping ID generation
2026-04-27 08:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 1
2026-04-27 08:14:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9a72b18-588d-5085-b89f-6448e85a5c91 sending to next pipeline
2026-04-27 08:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9a72b18-588d-5085-b89f-6448e85a5c91, identifier: DG46200
2026-04-27 08:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-04-27 08:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-04-27 08:14:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200 to the API
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'city': 'Germersheim',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-04-28T15:17:40Z',
 'fuel_type': 'petrol',
 'id': 'a9a72b18-588d-5085-b89f-6448e85a5c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG46200',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'BMW',
 'model': '5er',
 'odometer': 159787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2011-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-04-27 08:14:39 [auto1.de] INFO: Saving data for DG46200: {'created_time': 1777277679.383382, 'last_price_update_time': 1777277679.383392, 'has_photos': True, 'auction_closing_time': 1777389460.0}
2026-04-27 08:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3008400d-b191-52a5-8ebb-abb3e5a40e62 with identifier: XG32148
2026-04-27 08:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3008400d-b191-52a5-8ebb-abb3e5a40e62 with identifier: XG32148
2026-04-27 08:14:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3008400d-b191-52a5-8ebb-abb3e5a40e62 with identifier: XG32148 to the API
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:39 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Seddiner See',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:45:12Z',
 'fuel_type': 'diesel',
 'id': '3008400d-b191-52a5-8ebb-abb3e5a40e62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG32148',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 251584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f9db48edd202ac4d59398b51b1a69953.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_96b3af6348f2f1d210f657eb876fb6be.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_062721999560a86fd0cc10dc72d852f7.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_05f615f54f79506b0e053b55687744f4.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f8268795bdf32f684374b86fdb9ff8bf.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_e1ea77915ac0f33c7a379ac5a8d8d72d.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_dbbf8245e9759d22dedc69f1a19f1a57.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_15d32f6bbc7888337a4bdda8fb831147.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_4c71703ca40d0bfb0c3b6532836cb4e9.jpg',
                'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_91db8b4e56d06bfb647ba1e850ad7d78.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f9db48edd202ac4d59398b51b1a69953.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_062721999560a86fd0cc10dc72d852f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_05f615f54f79506b0e053b55687744f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_f8268795bdf32f684374b86fdb9ff8bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_e1ea77915ac0f33c7a379ac5a8d8d72d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_dbbf8245e9759d22dedc69f1a19f1a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_15d32f6bbc7888337a4bdda8fb831147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_4c71703ca40d0bfb0c3b6532836cb4e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3008400d-b191-52a5-8ebb-abb3e5a40e62/3008400d-b191-52a5-8ebb-abb3e5a40e62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/9e/e09e2f417ec74aca00690d6532c1849c/pa/XG32148_91db8b4e56d06bfb647ba1e850ad7d78.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2015-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2015}
2026-04-27 08:14:39 [auto1.de] INFO: Saving data for XG32148: {'created_time': 1777277679.689478, 'last_price_update_time': 1777277679.689487, 'has_photos': True, 'auction_closing_time': 1777391112.0}
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 3008400d-b191-52a5-8ebb-abb3e5a40e62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300baf50>
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ed0f10>
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaa690>
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f67510>
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg saved to cache
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 999a931d-383e-5c23-957a-44c188909021
2026-04-27 08:14:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 999a931d-383e-5c23-957a-44c188909021, skipping ID generation
2026-04-27 08:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999a931d-383e-5c23-957a-44c188909021 with scrape type 1
2026-04-27 08:14:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 999a931d-383e-5c23-957a-44c188909021 sending to next pipeline
2026-04-27 08:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 999a931d-383e-5c23-957a-44c188909021, identifier: KS92375
2026-04-27 08:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-04-27 08:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375
2026-04-27 08:14:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 999a931d-383e-5c23-957a-44c188909021 with identifier: KS92375 to the API
2026-04-27 08:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:11:15Z',
 'fuel_type': 'diesel',
 'id': '999a931d-383e-5c23-957a-44c188909021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS92375',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 241257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_2940d7911d4ed626489c55f03b6a7297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_10372d6a6016079e98cc88733046a1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_d111e28c65a356a4b181af2ae75618dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_f3b1733715b4e555942e3120dc46637c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_999a931d-383e-5c23-957a-44c188909021/999a931d-383e-5c23-957a-44c188909021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/b6/bab661a2dd180e3ff157fc068c3e8a58/pa/KS92375_7c57c1deffdb7f7e0cefb8f02be69072.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2013-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2013}
2026-04-27 08:14:40 [auto1.de] INFO: Saving data for KS92375: {'created_time': 1777277680.293663, 'last_price_update_time': 1777277680.293672, 'has_photos': True, 'auction_closing_time': 1777389075.0}
2026-04-27 08:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC77974> (referer: https://www.auto1.com/v1/car-details-view/XC77974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-04-27 08:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b054cc42-7d67-5d96-8533-0a4be33b810d with scrape type 1
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b4eb333ea170482cb32fcce969e0d0f0.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7cc5e89c8e7d47c30d5d39cff8357968.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_2567dc9e9687a2caf74c8a50a3cfa2ce.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_88d0b599835c016e1e18585768b45ac0.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_64262929c71acac8a6f0c964c529e84e.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_a8fa61bee162151d93bf79f4a82ccc8a.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b0fc1e8c8d9038cbf91cea3da50ca785.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7e78ec0374e47b7751c15fdec7c92fe0.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_0cd97cb7c8807926f5601bd41e745d39.jpg not downloaded yet
2026-04-27 08:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_dbac3460d0f319a66f43c411da7faae1.jpg not downloaded yet
2026-04-27 08:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL76993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH70383> (referer: https://www.auto1.com/v1/car-details-view/GH70383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_dbac3460d0f319a66f43c411da7faae1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-04-27 08:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d29eb19-ec57-5d13-aae5-789da9230f13 with scrape type 1
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_852cf952ea29f80422fe990fd537b008.jpg not downloaded yet
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_2800aa00cdb3132e4002675d50ec0f6f.jpg not downloaded yet
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_3d05cd6dc66ac8f74de6e5cc6e2d1c14.jpg not downloaded yet
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_dc2ee5f224671567d842b2e6d9435bd4.jpg not downloaded yet
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f65290>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_dbac3460d0f319a66f43c411da7faae1.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_e78afa28d02c90c6b348ea0413720f77.jpg not downloaded yet
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_0cd97cb7c8807926f5601bd41e745d39.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_5a1278bcd80bd78134e2b2a1c01c8599.jpg not downloaded yet
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e15390>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_0cd97cb7c8807926f5601bd41e745d39.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_e78afa28d02c90c6b348ea0413720f77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eb9090>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_e78afa28d02c90c6b348ea0413720f77.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_5a1278bcd80bd78134e2b2a1c01c8599.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4750>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_5a1278bcd80bd78134e2b2a1c01c8599.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:43 [scrapy.extensions.logstats] INFO: Crawled 738 pages (at 26 pages/min), scraped 335 items (at 15 items/min)
2026-04-27 08:14:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_dc2ee5f224671567d842b2e6d9435bd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300c8790>
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_dc2ee5f224671567d842b2e6d9435bd4.jpg saved to cache
2026-04-27 08:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_3d05cd6dc66ac8f74de6e5cc6e2d1c14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d52ed0>
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_3d05cd6dc66ac8f74de6e5cc6e2d1c14.jpg saved to cache
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_2800aa00cdb3132e4002675d50ec0f6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_852cf952ea29f80422fe990fd537b008.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301bc790>
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_2800aa00cdb3132e4002675d50ec0f6f.jpg saved to cache
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d505d0>
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_852cf952ea29f80422fe990fd537b008.jpg saved to cache
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d29eb19-ec57-5d13-aae5-789da9230f13
2026-04-27 08:14:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d29eb19-ec57-5d13-aae5-789da9230f13, skipping ID generation
2026-04-27 08:14:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d29eb19-ec57-5d13-aae5-789da9230f13 with scrape type 1
2026-04-27 08:14:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d29eb19-ec57-5d13-aae5-789da9230f13 sending to next pipeline
2026-04-27 08:14:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d29eb19-ec57-5d13-aae5-789da9230f13, identifier: GH70383
2026-04-27 08:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-04-27 08:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-04-27 08:14:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383 to the API
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_852cf952ea29f80422fe990fd537b008.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'city': 'Sulz am Neckar',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:13:36Z',
 'fuel_type': 'diesel',
 'id': '1d29eb19-ec57-5d13-aae5-789da9230f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.3624,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH70383',
 'listing': 'auction',
 'location': 'Sulz am Neckar',
 'location_confidence': 'geocoded',
 'longitude': 8.6331,
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 325746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_852cf952ea29f80422fe990fd537b008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_2800aa00cdb3132e4002675d50ec0f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_3d05cd6dc66ac8f74de6e5cc6e2d1c14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_dc2ee5f224671567d842b2e6d9435bd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_e78afa28d02c90c6b348ea0413720f77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d29eb19-ec57-5d13-aae5-789da9230f13/1d29eb19-ec57-5d13-aae5-789da9230f13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/cf/16cf4c79754463656de880b554140341/pa/GH70383_5a1278bcd80bd78134e2b2a1c01c8599.jpg',
             'Width': 800}],
 'postal_code': '72172',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2010-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-04-27 08:14:45 [auto1.de] INFO: Saving data for GH70383: {'created_time': 1777277685.099712, 'last_price_update_time': 1777277685.099724, 'has_photos': True, 'auction_closing_time': 1777389216.0}
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7e78ec0374e47b7751c15fdec7c92fe0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30078690>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7e78ec0374e47b7751c15fdec7c92fe0.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b0fc1e8c8d9038cbf91cea3da50ca785.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e412d0>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b0fc1e8c8d9038cbf91cea3da50ca785.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_a8fa61bee162151d93bf79f4a82ccc8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301d5e90>
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_a8fa61bee162151d93bf79f4a82ccc8a.jpg saved to cache
2026-04-27 08:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_64262929c71acac8a6f0c964c529e84e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e40590>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_64262929c71acac8a6f0c964c529e84e.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_88d0b599835c016e1e18585768b45ac0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9c350>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_88d0b599835c016e1e18585768b45ac0.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_2567dc9e9687a2caf74c8a50a3cfa2ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a73ad0>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_2567dc9e9687a2caf74c8a50a3cfa2ce.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7cc5e89c8e7d47c30d5d39cff8357968.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b4eb333ea170482cb32fcce969e0d0f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d9e590>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7cc5e89c8e7d47c30d5d39cff8357968.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4f650>
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b4eb333ea170482cb32fcce969e0d0f0.jpg saved to cache
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b054cc42-7d67-5d96-8533-0a4be33b810d
2026-04-27 08:14:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b054cc42-7d67-5d96-8533-0a4be33b810d, skipping ID generation
2026-04-27 08:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b054cc42-7d67-5d96-8533-0a4be33b810d with scrape type 1
2026-04-27 08:14:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b054cc42-7d67-5d96-8533-0a4be33b810d sending to next pipeline
2026-04-27 08:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b054cc42-7d67-5d96-8533-0a4be33b810d, identifier: XC77974
2026-04-27 08:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-04-27 08:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-04-27 08:14:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974 to the API
2026-04-27 08:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b4eb333ea170482cb32fcce969e0d0f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'city': 'Atting',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-04-28T15:46:02Z',
 'fuel_type': 'hybrid',
 'id': 'b054cc42-7d67-5d96-8533-0a4be33b810d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC77974',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 19077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b4eb333ea170482cb32fcce969e0d0f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7cc5e89c8e7d47c30d5d39cff8357968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_2567dc9e9687a2caf74c8a50a3cfa2ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_88d0b599835c016e1e18585768b45ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_64262929c71acac8a6f0c964c529e84e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_a8fa61bee162151d93bf79f4a82ccc8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_b0fc1e8c8d9038cbf91cea3da50ca785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_7e78ec0374e47b7751c15fdec7c92fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_0cd97cb7c8807926f5601bd41e745d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b054cc42-7d67-5d96-8533-0a4be33b810d/b054cc42-7d67-5d96-8533-0a4be33b810d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151df7ecddc4fd7ef54d438e89b32603/pa/XC77974_dbac3460d0f319a66f43c411da7faae1.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2021-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro 1.6 Plug-in Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2021}
2026-04-27 08:14:47 [auto1.de] INFO: Saving data for XC77974: {'created_time': 1777277687.933074, 'last_price_update_time': 1777277687.933083, 'has_photos': True, 'auction_closing_time': 1777391162.0}
2026-04-27 08:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM81124> (referer: https://www.auto1.com/v1/car-details-view/DM81124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-04-27 08:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af516880-8934-58d4-8f84-eb5031f2d0ce with scrape type 1
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg not downloaded yet
2026-04-27 08:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg not downloaded yet
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC91359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT52767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300924d0>
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg saved to cache
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04050>
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg saved to cache
2026-04-27 08:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT52067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK35739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300f0b50>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA71760> (referer: https://www.auto1.com/v1/car-details-view/XA71760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with identifier: XA71760
2026-04-27 08:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with scrape type 1
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_5e725d93ec480c5a1e44ef76852d8fe3.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_69efd67039cd44f56451d09c86aad838.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_b64fef5b2757757110be269514e4cc3e.jpg not downloaded yet
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_8c81a0b9a7017e06c7454aa932132ec0.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_42e07befb68317aa97e0d882db89a5b6.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_6be024ff6ce78b5f3a3649e1047eab2a.jpg not downloaded yet
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4fc90>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_7f1a8a459769aa5cfebc7b622227c8ed.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_3747dcffae16a03b7b169548bf759033.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_08bc174d2d56f08725f3a63683d0e850.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_4ce95da033f276a253f8eb0cea29d2e5.jpg not downloaded yet
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b03310>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-04-27 08:14:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af516880-8934-58d4-8f84-eb5031f2d0ce, skipping ID generation
2026-04-27 08:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af516880-8934-58d4-8f84-eb5031f2d0ce with scrape type 1
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af516880-8934-58d4-8f84-eb5031f2d0ce sending to next pipeline
2026-04-27 08:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af516880-8934-58d4-8f84-eb5031f2d0ce, identifier: DM81124
2026-04-27 08:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-04-27 08:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-04-27 08:14:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124 to the API
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Ellerau',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:22:15Z',
 'fuel_type': 'petrol',
 'id': 'af516880-8934-58d4-8f84-eb5031f2d0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM81124',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Peugeot',
 'model': '208',
 'odometer': 135390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2013-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-04-27 08:14:52 [auto1.de] INFO: Saving data for DM81124: {'created_time': 1777277692.066156, 'last_price_update_time': 1777277692.066167, 'has_photos': True, 'auction_closing_time': 1777389735.0}
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_b64fef5b2757757110be269514e4cc3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX24821> (referer: https://www.auto1.com/v1/car-details-view/YX24821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY91378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b59d50>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_b64fef5b2757757110be269514e4cc3e.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df5db5ae-0df6-56f3-a9ef-c631e48f76ca with identifier: YX24821
2026-04-27 08:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca with scrape type 1
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_098a16c2dc7327425d757fb88ce9221e.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_cf96d3e3a52408444438e3496f400c0d.jpg not downloaded yet
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_3747dcffae16a03b7b169548bf759033.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_08bc174d2d56f08725f3a63683d0e850.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_4ce95da033f276a253f8eb0cea29d2e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c7826c688e98139f2fa5e5d4b7e2a106.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_f01ef6e541a5ba533e79e31e369d6925.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_10f0b8dbfb89421d54a4dff6e2538f47.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_90f83f5b61b3d8840460300183ea4e66.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_54344b8e8c861d7c6053fffaa776d6f8.jpg not downloaded yet
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_098a16c2dc7327425d757fb88ce9221e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_9cd2ad3e889a014987ee322a6efc4084.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c486aac66fbd0c9592c6ab34353fb4fa.jpg not downloaded yet
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_86814e070ffd0d61574e16294585d390.jpg not downloaded yet
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300d0150>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_3747dcffae16a03b7b169548bf759033.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cad290>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_08bc174d2d56f08725f3a63683d0e850.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a282d0>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_4ce95da033f276a253f8eb0cea29d2e5.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_cf96d3e3a52408444438e3496f400c0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44450>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_098a16c2dc7327425d757fb88ce9221e.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_54344b8e8c861d7c6053fffaa776d6f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30057ad0>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_cf96d3e3a52408444438e3496f400c0d.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_86814e070ffd0d61574e16294585d390.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c486aac66fbd0c9592c6ab34353fb4fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c850>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_54344b8e8c861d7c6053fffaa776d6f8.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004bb90>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_86814e070ffd0d61574e16294585d390.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_9cd2ad3e889a014987ee322a6efc4084.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3003a650>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c486aac66fbd0c9592c6ab34353fb4fa.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_90f83f5b61b3d8840460300183ea4e66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb3dd0>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_9cd2ad3e889a014987ee322a6efc4084.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b88950>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_90f83f5b61b3d8840460300183ea4e66.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_10f0b8dbfb89421d54a4dff6e2538f47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_f01ef6e541a5ba533e79e31e369d6925.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22fb0350>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_10f0b8dbfb89421d54a4dff6e2538f47.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c7826c688e98139f2fa5e5d4b7e2a106.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3f0f2f50>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_f01ef6e541a5ba533e79e31e369d6925.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_7f1a8a459769aa5cfebc7b622227c8ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS14659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049810>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c7826c688e98139f2fa5e5d4b7e2a106.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca
2026-04-27 08:14:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df5db5ae-0df6-56f3-a9ef-c631e48f76ca, skipping ID generation
2026-04-27 08:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca with scrape type 1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df5db5ae-0df6-56f3-a9ef-c631e48f76ca sending to next pipeline
2026-04-27 08:14:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df5db5ae-0df6-56f3-a9ef-c631e48f76ca, identifier: YX24821
2026-04-27 08:14:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df5db5ae-0df6-56f3-a9ef-c631e48f76ca with identifier: YX24821
2026-04-27 08:14:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df5db5ae-0df6-56f3-a9ef-c631e48f76ca with identifier: YX24821
2026-04-27 08:14:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df5db5ae-0df6-56f3-a9ef-c631e48f76ca with identifier: YX24821 to the API
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c7826c688e98139f2fa5e5d4b7e2a106.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'city': 'Ellerau',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-04-28T15:15:39Z',
 'fuel_type': 'petrol',
 'id': 'df5db5ae-0df6-56f3-a9ef-c631e48f76ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 53.75,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX24821',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'location_confidence': 'geocoded',
 'longitude': 9.9167,
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 132062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_098a16c2dc7327425d757fb88ce9221e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_cf96d3e3a52408444438e3496f400c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c7826c688e98139f2fa5e5d4b7e2a106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_f01ef6e541a5ba533e79e31e369d6925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_10f0b8dbfb89421d54a4dff6e2538f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_90f83f5b61b3d8840460300183ea4e66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_54344b8e8c861d7c6053fffaa776d6f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_9cd2ad3e889a014987ee322a6efc4084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_c486aac66fbd0c9592c6ab34353fb4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df5db5ae-0df6-56f3-a9ef-c631e48f76ca/df5db5ae-0df6-56f3-a9ef-c631e48f76ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/8f/4e8f14ff8278c461aacbac9d5bb9f16d/pa/YX24821_86814e070ffd0d61574e16294585d390.jpg',
             'Width': 800}],
 'postal_code': '25479',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Schleswig-Holstein',
 'region_code': 'DE-SH',
 'registration_date': '2015-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-04-27 08:14:54 [auto1.de] INFO: Saving data for YX24821: {'created_time': 1777277694.197865, 'last_price_update_time': 1777277694.197877, 'has_photos': True, 'auction_closing_time': 1777389339.0}
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_8c81a0b9a7017e06c7454aa932132ec0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_6be024ff6ce78b5f3a3649e1047eab2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_42e07befb68317aa97e0d882db89a5b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8b6d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_7f1a8a459769aa5cfebc7b622227c8ed.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_5e725d93ec480c5a1e44ef76852d8fe3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a56e10>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_8c81a0b9a7017e06c7454aa932132ec0.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a289d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_6be024ff6ce78b5f3a3649e1047eab2a.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004c6d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_42e07befb68317aa97e0d882db89a5b6.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_69efd67039cd44f56451d09c86aad838.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65c50>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_5e725d93ec480c5a1e44ef76852d8fe3.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a8b810>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_69efd67039cd44f56451d09c86aad838.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5
2026-04-27 08:14:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5, skipping ID generation
2026-04-27 08:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with scrape type 1
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 sending to next pipeline
2026-04-27 08:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5, identifier: XA71760
2026-04-27 08:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with identifier: XA71760
2026-04-27 08:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with identifier: XA71760
2026-04-27 08:14:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b74fc79-7aee-55c7-9737-9a2e35c9ece5 with identifier: XA71760 to the API
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_69efd67039cd44f56451d09c86aad838.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'city': 'Schöneck-Kilianstädten',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-04-28T15:23:49Z',
 'fuel_type': 'petrol',
 'id': '3b74fc79-7aee-55c7-9737-9a2e35c9ece5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 50.2056,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA71760',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'location_confidence': 'geocoded',
 'longitude': 8.8333,
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 46112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_5e725d93ec480c5a1e44ef76852d8fe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_69efd67039cd44f56451d09c86aad838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_b64fef5b2757757110be269514e4cc3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_8c81a0b9a7017e06c7454aa932132ec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_42e07befb68317aa97e0d882db89a5b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_6be024ff6ce78b5f3a3649e1047eab2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_7f1a8a459769aa5cfebc7b622227c8ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_3747dcffae16a03b7b169548bf759033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_08bc174d2d56f08725f3a63683d0e850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b74fc79-7aee-55c7-9737-9a2e35c9ece5/3b74fc79-7aee-55c7-9737-9a2e35c9ece5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/34/20347a25b3398e99778c5ab31a39fad1/pa/XA71760_4ce95da033f276a253f8eb0cea29d2e5.jpg',
             'Width': 800}],
 'postal_code': '61137',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Darmstadt',
 'province_code': 'DE-064',
 'region': 'Hessen',
 'region_code': 'DE-HE',
 'registration_date': '2019-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2019}
2026-04-27 08:14:55 [auto1.de] INFO: Saving data for XA71760: {'created_time': 1777277695.065989, 'last_price_update_time': 1777277695.065998, 'has_photos': True, 'auction_closing_time': 1777389829.0}
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR53250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ19691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC91359> (referer: https://www.auto1.com/v1/car-details-view/WC91359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with identifier: WC91359
2026-04-27 08:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with scrape type 1
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_152b7bc22081dede79cef3965fcf6068.jpg not downloaded yet
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_23744053ab0b57fe510fcb1df17e9c68.jpg not downloaded yet
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_44947bca43b36d43734d94e62d0b703b.jpg not downloaded yet
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_faa36d44a414624711c7b66614d43f69.jpg not downloaded yet
2026-04-27 08:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_8f5320b9992f158d832d7ffac18c5c48.jpg not downloaded yet
2026-04-27 08:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB07132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_8f5320b9992f158d832d7ffac18c5c48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22feb950>
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_8f5320b9992f158d832d7ffac18c5c48.jpg saved to cache
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK35739> (referer: https://www.auto1.com/v1/car-details-view/PK35739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with identifier: PK35739
2026-04-27 08:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with scrape type 1
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_87a26a66f32dfb0e475e7eac25fc155e.jpg not downloaded yet
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_a33f5c8afe69d536328b458dcd964fbf.jpg not downloaded yet
2026-04-27 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_f0679fdba440f0c0663f4b87597381d6.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_8d3db9f2db1cb24b6adbc029314a33ae.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_720574f6d68f2298335cb3b744ad4713.jpg not downloaded yet
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_faa36d44a414624711c7b66614d43f69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_78da6bd1423f6cd80ddcca787e044f5f.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_c4d37590b45d4940af45dece6fcf3829.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_7f9de72d2fedbb8d0163fcd23086a9aa.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_5637eb9c701f0e5e0217241e31be9054.jpg not downloaded yet
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_38a0285d943fec13010a71fcc19cde13.jpg not downloaded yet
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3e7f5290>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_faa36d44a414624711c7b66614d43f69.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_720574f6d68f2298335cb3b744ad4713.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f68190>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_720574f6d68f2298335cb3b744ad4713.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_38a0285d943fec13010a71fcc19cde13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_5637eb9c701f0e5e0217241e31be9054.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f45390>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_38a0285d943fec13010a71fcc19cde13.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_7f9de72d2fedbb8d0163fcd23086a9aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f47910>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_5637eb9c701f0e5e0217241e31be9054.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_c4d37590b45d4940af45dece6fcf3829.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44090>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_7f9de72d2fedbb8d0163fcd23086a9aa.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_78da6bd1423f6cd80ddcca787e044f5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f46850>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_c4d37590b45d4940af45dece6fcf3829.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_8d3db9f2db1cb24b6adbc029314a33ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004a810>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_78da6bd1423f6cd80ddcca787e044f5f.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f44090>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_8d3db9f2db1cb24b6adbc029314a33ae.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_f0679fdba440f0c0663f4b87597381d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_a33f5c8afe69d536328b458dcd964fbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_87a26a66f32dfb0e475e7eac25fc155e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004a710>
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_f0679fdba440f0c0663f4b87597381d6.jpg saved to cache
2026-04-27 08:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300af690>
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_a33f5c8afe69d536328b458dcd964fbf.jpg saved to cache
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a29390>
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_87a26a66f32dfb0e475e7eac25fc155e.jpg saved to cache
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c
2026-04-27 08:15:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c, skipping ID generation
2026-04-27 08:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with scrape type 1
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c sending to next pipeline
2026-04-27 08:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c, identifier: PK35739
2026-04-27 08:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with identifier: PK35739
2026-04-27 08:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with identifier: PK35739
2026-04-27 08:15:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c with identifier: PK35739 to the API
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_87a26a66f32dfb0e475e7eac25fc155e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'city': 'Kerpen',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.9L',
 'engine_horse_power': 340,
 'expiration_date': '2026-04-28T15:29:48Z',
 'fuel_type': 'diesel',
 'id': 'e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 50.8748,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK35739',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'location_confidence': 'geocoded',
 'longitude': 6.7435,
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 54768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_87a26a66f32dfb0e475e7eac25fc155e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_a33f5c8afe69d536328b458dcd964fbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_f0679fdba440f0c0663f4b87597381d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_8d3db9f2db1cb24b6adbc029314a33ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_720574f6d68f2298335cb3b744ad4713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_78da6bd1423f6cd80ddcca787e044f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_c4d37590b45d4940af45dece6fcf3829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_7f9de72d2fedbb8d0163fcd23086a9aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_5637eb9c701f0e5e0217241e31be9054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c/e4ed448b-90b2-5759-8ac7-e6c53cdc9a8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/c8/8fc8bc483717a3b201528dcfa8232fc0/pa/PK35739_38a0285d943fec13010a71fcc19cde13.jpg',
             'Width': 800}],
 'postal_code': '50169',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Regierungsbezirk Köln',
 'province_code': 'DE-053',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2019-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-04-27 08:15:00 [auto1.de] INFO: Saving data for PK35739: {'created_time': 1777277700.733105, 'last_price_update_time': 1777277700.733114, 'has_photos': True, 'auction_closing_time': 1777390188.0}
2026-04-27 08:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_44947bca43b36d43734d94e62d0b703b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT52767> (referer: https://www.auto1.com/v1/car-details-view/FT52767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_152b7bc22081dede79cef3965fcf6068.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a11ad0>
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_44947bca43b36d43734d94e62d0b703b.jpg saved to cache
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c582a5c-219c-5611-ab6b-b5327246f636 with identifier: FT52767
2026-04-27 08:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c582a5c-219c-5611-ab6b-b5327246f636 with scrape type 1
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a1d1fc61203e3288acaf0a92b890eea3.jpg not downloaded yet
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_37c662f094d06dbddb7acd093056943b.jpg not downloaded yet
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_4d24ed17aa393c3b7ec9d9ea92c20f57.jpg not downloaded yet
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba4090>
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_152b7bc22081dede79cef3965fcf6068.jpg saved to cache
2026-04-27 08:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f7967e92ff014b98dac4eff2a7edf623.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_23744053ab0b57fe510fcb1df17e9c68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a93e0a02e8f5ca6966d6d74f96fe29fa.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_66c8c2da6734dd41ffa8aa0008211db8.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL76993> (referer: https://www.auto1.com/v1/car-details-view/CL76993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f924ee6922727243697d27cfa148e2e2.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_cc43efc2045658a49eee7514f5807f92.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_e0394443d34854f60c587c827f858740.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_d4cb6e89cdcd04b159fcfd293bf4e6a0.jpg not downloaded yet
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43f50>
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_23744053ab0b57fe510fcb1df17e9c68.jpg saved to cache
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b, skipping ID generation
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with scrape type 1
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4339bce6-0d72-5c4f-b122-00ddf57f9c3b sending to next pipeline
2026-04-27 08:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b, identifier: WC91359
2026-04-27 08:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with identifier: WC91359
2026-04-27 08:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with identifier: WC91359
2026-04-27 08:15:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4339bce6-0d72-5c4f-b122-00ddf57f9c3b with identifier: WC91359 to the API
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_23744053ab0b57fe510fcb1df17e9c68.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'city': 'Atting',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-04-28T15:19:02Z',
 'fuel_type': 'diesel',
 'id': '4339bce6-0d72-5c4f-b122-00ddf57f9c3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.8941,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC91359',
 'listing': 'auction',
 'location': 'DE, Atting',
 'location_confidence': 'geocoded',
 'longitude': 12.4878,
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 235756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_152b7bc22081dede79cef3965fcf6068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_23744053ab0b57fe510fcb1df17e9c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_44947bca43b36d43734d94e62d0b703b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_faa36d44a414624711c7b66614d43f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4339bce6-0d72-5c4f-b122-00ddf57f9c3b/4339bce6-0d72-5c4f-b122-00ddf57f9c3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/77/3077ba94fc666d9ee69e21465ddc9d43/pa/WC91359_8f5320b9992f158d832d7ffac18c5c48.jpg',
             'Width': 800}],
 'postal_code': '94348',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Lower Bavaria',
 'province_code': 'DE-092',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2013-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-04-27 08:15:01 [auto1.de] INFO: Saving data for WC91359: {'created_time': 1777277701.550019, 'last_price_update_time': 1777277701.550031, 'has_photos': True, 'auction_closing_time': 1777389542.0}
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a93e0a02e8f5ca6966d6d74f96fe29fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f7967e92ff014b98dac4eff2a7edf623.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6436877-0e8c-58e6-911e-728200800c4e with identifier: CL76993
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6436877-0e8c-58e6-911e-728200800c4e with scrape type 1
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_9b1ea03858df29a9dbe36827d154af9f.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_4109817fc1acd163540aad241a6cea41.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY91378> (referer: https://www.auto1.com/v1/car-details-view/EY91378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_0ea98751041d233d9fdbb7027dcefc84.jpg not downloaded yet
2026-04-27 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_07b69f7e30e14825b92ba49778ea2fe1.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_28046f52ced02bef27cb5609efde6ab4.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_f585a96311966e8fe8a4d07f54413f98.jpg not downloaded yet
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300aff10>
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a93e0a02e8f5ca6966d6d74f96fe29fa.jpg saved to cache
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a58650>
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f7967e92ff014b98dac4eff2a7edf623.jpg saved to cache
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_8c7cc91e894beb6844fd86540feb1b4d.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_80b143093f49fe72d8c6f1cb0fb26df7.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL59024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_d4cb6e89cdcd04b159fcfd293bf4e6a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_5a875de72f0101d8449a2f2c54bf11a0.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd89f900-e736-5a1d-a814-728f15b1b12f with identifier: EY91378
2026-04-27 08:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd89f900-e736-5a1d-a814-728f15b1b12f with scrape type 1
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_30e32d104e8d908860429f34dccfb86c.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_4109817fc1acd163540aad241a6cea41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_e0394443d34854f60c587c827f858740.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_691fb7669983763147cb1e078dcea224.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_cfa657cc4facb360569eadff7f283a08.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_6ea921ee273479f1cb2041b14b18a6a9.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_02c27beb01f835a56cba149ef06895c1.jpg not downloaded yet
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_bdea2a6255e84c6aa72f1eb3989ad330.jpg not downloaded yet
2026-04-27 08:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_30e32d104e8d908860429f34dccfb86c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_8086e884a25d8f28dd25afc14452d85c.jpg not downloaded yet
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a89bd0>
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_d4cb6e89cdcd04b159fcfd293bf4e6a0.jpg saved to cache
2026-04-27 08:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_e95c344c887158313343771c56de4138.jpg not downloaded yet
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_8c7cc91e894beb6844fd86540feb1b4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30049e90>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_4109817fc1acd163540aad241a6cea41.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a89150>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_e0394443d34854f60c587c827f858740.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_80b143093f49fe72d8c6f1cb0fb26df7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_573ce2c886a3b902a7200de16d658156.jpg not downloaded yet
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_f585a96311966e8fe8a4d07f54413f98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_bdea2a6255e84c6aa72f1eb3989ad330.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_b308232b34384b3b82996e38413b3cad.jpg not downloaded yet
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e43ad0>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_30e32d104e8d908860429f34dccfb86c.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ba5fd0>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_8c7cc91e894beb6844fd86540feb1b4d.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_9e7c6f71bec87340384eea7efe7f917b.jpg not downloaded yet
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65690>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_80b143093f49fe72d8c6f1cb0fb26df7.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_e95c344c887158313343771c56de4138.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30076190>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_f585a96311966e8fe8a4d07f54413f98.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a2d990>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_bdea2a6255e84c6aa72f1eb3989ad330.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_573ce2c886a3b902a7200de16d658156.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d300559d0>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_e95c344c887158313343771c56de4138.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_8086e884a25d8f28dd25afc14452d85c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2b290>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_573ce2c886a3b902a7200de16d658156.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301884d0>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_8086e884a25d8f28dd25afc14452d85c.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_9e7c6f71bec87340384eea7efe7f917b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_02c27beb01f835a56cba149ef06895c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_b308232b34384b3b82996e38413b3cad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4f2d0>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_9e7c6f71bec87340384eea7efe7f917b.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3eab2010>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_02c27beb01f835a56cba149ef06895c1.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b67010>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_b308232b34384b3b82996e38413b3cad.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_cfa657cc4facb360569eadff7f283a08.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV56220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_691fb7669983763147cb1e078dcea224.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_6ea921ee273479f1cb2041b14b18a6a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ12207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30040650>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_cfa657cc4facb360569eadff7f283a08.jpg saved to cache
2026-04-27 08:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_28046f52ced02bef27cb5609efde6ab4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_07b69f7e30e14825b92ba49778ea2fe1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_0ea98751041d233d9fdbb7027dcefc84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_5a875de72f0101d8449a2f2c54bf11a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b65d10>
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_691fb7669983763147cb1e078dcea224.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a795d0>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_6ea921ee273479f1cb2041b14b18a6a9.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd89f900-e736-5a1d-a814-728f15b1b12f
2026-04-27 08:15:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd89f900-e736-5a1d-a814-728f15b1b12f, skipping ID generation
2026-04-27 08:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd89f900-e736-5a1d-a814-728f15b1b12f with scrape type 1
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd89f900-e736-5a1d-a814-728f15b1b12f sending to next pipeline
2026-04-27 08:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd89f900-e736-5a1d-a814-728f15b1b12f, identifier: EY91378
2026-04-27 08:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd89f900-e736-5a1d-a814-728f15b1b12f with identifier: EY91378
2026-04-27 08:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd89f900-e736-5a1d-a814-728f15b1b12f with identifier: EY91378
2026-04-27 08:15:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd89f900-e736-5a1d-a814-728f15b1b12f with identifier: EY91378 to the API
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_6ea921ee273479f1cb2041b14b18a6a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'city': 'Schkopau',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-04-28T15:59:29Z',
 'fuel_type': 'petrol',
 'id': 'cd89f900-e736-5a1d-a814-728f15b1b12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.4,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY91378',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'location_confidence': 'geocoded',
 'longitude': 12.0463,
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_30e32d104e8d908860429f34dccfb86c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_cfa657cc4facb360569eadff7f283a08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_6ea921ee273479f1cb2041b14b18a6a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_02c27beb01f835a56cba149ef06895c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_bdea2a6255e84c6aa72f1eb3989ad330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_8086e884a25d8f28dd25afc14452d85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_e95c344c887158313343771c56de4138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_573ce2c886a3b902a7200de16d658156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_b308232b34384b3b82996e38413b3cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd89f900-e736-5a1d-a814-728f15b1b12f/cd89f900-e736-5a1d-a814-728f15b1b12f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c1/bac11e9c329209dc61efa7495695ba40/pa/EY91378_9e7c6f71bec87340384eea7efe7f917b.jpg',
             'Width': 800}],
 'postal_code': '06179',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Sachsen-Anhalt',
 'region_code': 'DE-ST',
 'registration_date': '2015-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-04-27 08:15:03 [auto1.de] INFO: Saving data for EY91378: {'created_time': 1777277703.724319, 'last_price_update_time': 1777277703.724332, 'has_photos': True, 'auction_closing_time': 1777391969.0}
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f924ee6922727243697d27cfa148e2e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_cc43efc2045658a49eee7514f5807f92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG14564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b87cd0>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_28046f52ced02bef27cb5609efde6ab4.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ceff90>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_07b69f7e30e14825b92ba49778ea2fe1.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3011ffd0>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_0ea98751041d233d9fdbb7027dcefc84.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cef850>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_5a875de72f0101d8449a2f2c54bf11a0.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6436877-0e8c-58e6-911e-728200800c4e
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_66c8c2da6734dd41ffa8aa0008211db8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB74437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026df90>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f924ee6922727243697d27cfa148e2e2.jpg saved to cache
2026-04-27 08:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b64e10>
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_cc43efc2045658a49eee7514f5807f92.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_4d24ed17aa393c3b7ec9d9ea92c20f57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a1d1fc61203e3288acaf0a92b890eea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f3b90>
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_66c8c2da6734dd41ffa8aa0008211db8.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6436877-0e8c-58e6-911e-728200800c4e with identifier: CL76993
2026-04-27 08:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6436877-0e8c-58e6-911e-728200800c4e with identifier: CL76993
2026-04-27 08:15:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6436877-0e8c-58e6-911e-728200800c4e with identifier: CL76993 to the API
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:04 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'city': 'Seddiner See',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-04-28T15:01:35Z',
 'fuel_type': 'petrol',
 'id': 'd6436877-0e8c-58e6-911e-728200800c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL76993',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 100690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_9b1ea03858df29a9dbe36827d154af9f.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_4109817fc1acd163540aad241a6cea41.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_0ea98751041d233d9fdbb7027dcefc84.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_07b69f7e30e14825b92ba49778ea2fe1.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_28046f52ced02bef27cb5609efde6ab4.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_f585a96311966e8fe8a4d07f54413f98.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_8c7cc91e894beb6844fd86540feb1b4d.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_80b143093f49fe72d8c6f1cb0fb26df7.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_5a875de72f0101d8449a2f2c54bf11a0.jpg',
                'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_691fb7669983763147cb1e078dcea224.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_4109817fc1acd163540aad241a6cea41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_0ea98751041d233d9fdbb7027dcefc84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_07b69f7e30e14825b92ba49778ea2fe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_28046f52ced02bef27cb5609efde6ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_f585a96311966e8fe8a4d07f54413f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_8c7cc91e894beb6844fd86540feb1b4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_80b143093f49fe72d8c6f1cb0fb26df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_5a875de72f0101d8449a2f2c54bf11a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d6436877-0e8c-58e6-911e-728200800c4e/d6436877-0e8c-58e6-911e-728200800c4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/b3/29b3ba4f35b008f1fc541d02a5612144/pa/CL76993_691fb7669983763147cb1e078dcea224.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2018-01-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2018}
2026-04-27 08:15:04 [auto1.de] INFO: Saving data for CL76993: {'created_time': 1777277704.411461, 'last_price_update_time': 1777277704.41147, 'has_photos': True, 'auction_closing_time': 1777388495.0}
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item d6436877-0e8c-58e6-911e-728200800c4e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_37c662f094d06dbddb7acd093056943b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f30d0>
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_4d24ed17aa393c3b7ec9d9ea92c20f57.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3026f910>
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a1d1fc61203e3288acaf0a92b890eea3.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc2e90>
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_37c662f094d06dbddb7acd093056943b.jpg saved to cache
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c582a5c-219c-5611-ab6b-b5327246f636
2026-04-27 08:15:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c582a5c-219c-5611-ab6b-b5327246f636, skipping ID generation
2026-04-27 08:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c582a5c-219c-5611-ab6b-b5327246f636 with scrape type 1
2026-04-27 08:15:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c582a5c-219c-5611-ab6b-b5327246f636 sending to next pipeline
2026-04-27 08:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c582a5c-219c-5611-ab6b-b5327246f636, identifier: FT52767
2026-04-27 08:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c582a5c-219c-5611-ab6b-b5327246f636 with identifier: FT52767
2026-04-27 08:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c582a5c-219c-5611-ab6b-b5327246f636 with identifier: FT52767
2026-04-27 08:15:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c582a5c-219c-5611-ab6b-b5327246f636 with identifier: FT52767 to the API
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_37c662f094d06dbddb7acd093056943b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'city': 'Dortmund',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-04-28T15:17:46Z',
 'fuel_type': 'petrol',
 'id': '6c582a5c-219c-5611-ab6b-b5327246f636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 51.5125,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT52767',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'location_confidence': 'geocoded',
 'longitude': 7.477,
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 70563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a1d1fc61203e3288acaf0a92b890eea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_37c662f094d06dbddb7acd093056943b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_4d24ed17aa393c3b7ec9d9ea92c20f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f7967e92ff014b98dac4eff2a7edf623.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_a93e0a02e8f5ca6966d6d74f96fe29fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_66c8c2da6734dd41ffa8aa0008211db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_f924ee6922727243697d27cfa148e2e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_cc43efc2045658a49eee7514f5807f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_e0394443d34854f60c587c827f858740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c582a5c-219c-5611-ab6b-b5327246f636/6c582a5c-219c-5611-ab6b-b5327246f636_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/3e/d13e4ec030d630106aa0312368ee2661/pa/FT52767_d4cb6e89cdcd04b159fcfd293bf4e6a0.jpg',
             'Width': 800}],
 'postal_code': '44135',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Reg.-Bez. Arnsberg',
 'province_code': 'DE-059',
 'region': 'Nordrhein-Westfalen',
 'region_code': 'DE-NW',
 'registration_date': '2013-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Spirit 2WD',
 'transmission': 'automatic',
 'trim': 'Spirit 2WD',
 'year': 2013}
2026-04-27 08:15:04 [auto1.de] INFO: Saving data for FT52767: {'created_time': 1777277704.990675, 'last_price_update_time': 1777277704.990684, 'has_photos': True, 'auction_closing_time': 1777389466.0}
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR53250> (referer: https://www.auto1.com/v1/car-details-view/YR53250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-04-27 08:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e387b3-e57a-588c-a9e3-6b18ce566e22 with scrape type 1
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_829ceb5355ab259be73e3aba2d75b112.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_88bacebfc3dfd7d18d08f2f85eaeba76.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_7475e77401631f6bd4674bc301fe37cd.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_4d5f5220a8733834a351b7a5b43c2577.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_99357360de1d70fb38ef6e3c689240ee.jpg not downloaded yet
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ19691> (referer: https://www.auto1.com/v1/car-details-view/LJ19691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_99357360de1d70fb38ef6e3c689240ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-04-27 08:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007deb63-0da1-5cc0-94bf-5464273ece29 with scrape type 1
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_988b0f6ffd11c41543734a30b993b543.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_8c1f07e54b637cc76c4fd9a71f8bc171.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_1f3bad03f1e3f7f70a6be02230ea7e41.jpg not downloaded yet
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_4d5f5220a8733834a351b7a5b43c2577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_a152fb861ee3e181024b0059e8162998.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_f3d0bd0a377ffb690e2399c8e3324062.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_adab44943d2b1ecb0c7025f89e1fdeb6.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_346fe55ab3834f739da3bef5ec451565.jpg not downloaded yet
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d821d0>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_99357360de1d70fb38ef6e3c689240ee.jpg saved to cache
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_62ca33d307fde56ec23d305284f3b731.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_384892d4b45fbeb6189c818b194329fa.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_56d953adb58863db9b6bb60e155e162c.jpg not downloaded yet
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22da2c50>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_4d5f5220a8733834a351b7a5b43c2577.jpg saved to cache
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG95933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_1f3bad03f1e3f7f70a6be02230ea7e41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b76e50>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_1f3bad03f1e3f7f70a6be02230ea7e41.jpg saved to cache
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_56d953adb58863db9b6bb60e155e162c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB07132> (referer: https://www.auto1.com/v1/car-details-view/UB07132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_384892d4b45fbeb6189c818b194329fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301f0650>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_56d953adb58863db9b6bb60e155e162c.jpg saved to cache
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-04-27 08:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with scrape type 1
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_7c86a0524246d86f8ea8beda6655fc56.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d268ce06d98242859f5894ebed1f1041.jpg not downloaded yet
2026-04-27 08:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_ecdab7d4c24ef6e8fe238151a03d4c86.jpg not downloaded yet
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a7bbd0>
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_384892d4b45fbeb6189c818b194329fa.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_346fe55ab3834f739da3bef5ec451565.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_62ca33d307fde56ec23d305284f3b731.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_cfaa1a5bb8bb02558109b58340d784e6.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b065def8000f19834dfddafeab381a4d.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_02e4eb4a6fd7ef975c2ffcb0a12840a8.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d5bd234762042621b05392f31b53fa10.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b12780645a31101b8d4f4873b3930546.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_e398dbf34b96a538d081055dc3cb6a42.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d4eea3aa5f9c34dfbbb74607ec11341d.jpg not downloaded yet
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d302e1890>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_346fe55ab3834f739da3bef5ec451565.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e91f10>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_62ca33d307fde56ec23d305284f3b731.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_ecdab7d4c24ef6e8fe238151a03d4c86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d268ce06d98242859f5894ebed1f1041.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT52067> (referer: https://www.auto1.com/v1/car-details-view/PT52067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04c10>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_ecdab7d4c24ef6e8fe238151a03d4c86.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL59024> (referer: https://www.auto1.com/v1/car-details-view/LL59024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d81e90>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d268ce06d98242859f5894ebed1f1041.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-04-27 08:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 1
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fe24376c7df79aa3c8a7893e0693da96.jpg not downloaded yet
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_e398dbf34b96a538d081055dc3cb6a42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d4eea3aa5f9c34dfbbb74607ec11341d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fcff6d22ec18d899eb67ca3e6c7dfec2.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_c0a94ff167f0c43c8e08e58d3c4f0939.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_7dba3d710bc210b3a52ae52bf827b6d2.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-04-27 08:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3af0ed-0389-5599-9997-1072091e8ad1 with scrape type 1
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_0855680035807c75d0b24f937652ce4b.jpg not downloaded yet
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b12780645a31101b8d4f4873b3930546.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_add4886822770ebd0f9b3561289e56a1.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_cf2da3106a172030426bbb26ccf3c94f.jpg not downloaded yet
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fe24376c7df79aa3c8a7893e0693da96.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_df6472d47770de9f48916a8d11b13022.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_fcd2f01d015f876c6218a541aaf2effa.jpg not downloaded yet
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04050>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_e398dbf34b96a538d081055dc3cb6a42.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d534d0>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d4eea3aa5f9c34dfbbb74607ec11341d.jpg saved to cache
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d5bd234762042621b05392f31b53fa10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_02e4eb4a6fd7ef975c2ffcb0a12840a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_ae8dc9dc5f6456c537522e5ff20567af.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_f1d3429b576fc14ffb369bf234ae17af.jpg not downloaded yet
2026-04-27 08:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_0855680035807c75d0b24f937652ce4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_a37c1743661b7eb3ce12148a79add575.jpg not downloaded yet
2026-04-27 08:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_352b16aa285e5902e18542023d6f4f52.jpg not downloaded yet
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e20d10>
2026-04-27 08:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b12780645a31101b8d4f4873b3930546.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22e175d0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fe24376c7df79aa3c8a7893e0693da96.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fa97f6fb0ab415dd503cd3b66e94df3a.jpg not downloaded yet
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d6ec997fb1d13f72cb6cb07ca7399b96.jpg not downloaded yet
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_4faefb40098bb3ce2850d72f9bd41244.jpg not downloaded yet
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_c2a7aacc902b3c02962a67a6e6b647c8.jpg not downloaded yet
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_cf2da3106a172030426bbb26ccf3c94f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_fcd2f01d015f876c6218a541aaf2effa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a29110>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d5bd234762042621b05392f31b53fa10.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018ae90>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_02e4eb4a6fd7ef975c2ffcb0a12840a8.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cefbd0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_0855680035807c75d0b24f937652ce4b.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_df6472d47770de9f48916a8d11b13022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_3d7047aa9c46236ff52a373ea4557e2d.jpg not downloaded yet
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_add4886822770ebd0f9b3561289e56a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d466cded11a0b44618bd926b913bf846.jpg not downloaded yet
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3018a4d0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_cf2da3106a172030426bbb26ccf3c94f.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b04b90>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_fcd2f01d015f876c6218a541aaf2effa.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_ec49045bf50a78c5f7643e7f1ba3c030.jpg not downloaded yet
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecfbd0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_df6472d47770de9f48916a8d11b13022.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b75cd0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_add4886822770ebd0f9b3561289e56a1.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fa97f6fb0ab415dd503cd3b66e94df3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d6ec997fb1d13f72cb6cb07ca7399b96.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_c2a7aacc902b3c02962a67a6e6b647c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_3d7047aa9c46236ff52a373ea4557e2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_ec49045bf50a78c5f7643e7f1ba3c030.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_4faefb40098bb3ce2850d72f9bd41244.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d301aa610>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fa97f6fb0ab415dd503cd3b66e94df3a.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b8b1d0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d6ec997fb1d13f72cb6cb07ca7399b96.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d466cded11a0b44618bd926b913bf846.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f8c050>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_c2a7aacc902b3c02962a67a6e6b647c8.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d320bfb50>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_3d7047aa9c46236ff52a373ea4557e2d.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_352b16aa285e5902e18542023d6f4f52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_a37c1743661b7eb3ce12148a79add575.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_f1d3429b576fc14ffb369bf234ae17af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a78a90>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_ec49045bf50a78c5f7643e7f1ba3c030.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eced10>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_4faefb40098bb3ce2850d72f9bd41244.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3ebe8410>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d466cded11a0b44618bd926b913bf846.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a109d0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_352b16aa285e5902e18542023d6f4f52.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ecddd0>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_a37c1743661b7eb3ce12148a79add575.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cec510>
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_f1d3429b576fc14ffb369bf234ae17af.jpg saved to cache
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d3af0ed-0389-5599-9997-1072091e8ad1
2026-04-27 08:15:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d3af0ed-0389-5599-9997-1072091e8ad1, skipping ID generation
2026-04-27 08:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3af0ed-0389-5599-9997-1072091e8ad1 with scrape type 1
2026-04-27 08:15:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d3af0ed-0389-5599-9997-1072091e8ad1 sending to next pipeline
2026-04-27 08:15:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d3af0ed-0389-5599-9997-1072091e8ad1, identifier: LL59024
2026-04-27 08:15:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-04-27 08:15:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-04-27 08:15:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024 to the API
2026-04-27 08:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_f1d3429b576fc14ffb369bf234ae17af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'city': 'Lüdersfeld',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-04-28T15:44:13Z',
 'fuel_type': 'diesel',
 'id': '4d3af0ed-0389-5599-9997-1072091e8ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.3599,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL59024',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'location_confidence': 'geocoded',
 'longitude': 9.2542,
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 112530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_0855680035807c75d0b24f937652ce4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_cf2da3106a172030426bbb26ccf3c94f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_fcd2f01d015f876c6218a541aaf2effa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_f1d3429b576fc14ffb369bf234ae17af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_352b16aa285e5902e18542023d6f4f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d6ec997fb1d13f72cb6cb07ca7399b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_c2a7aacc902b3c02962a67a6e6b647c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_3d7047aa9c46236ff52a373ea4557e2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_d466cded11a0b44618bd926b913bf846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d3af0ed-0389-5599-9997-1072091e8ad1/4d3af0ed-0389-5599-9997-1072091e8ad1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/7d/f57dfca9e41389d60a5ef85992f574f2/pa/LL59024_ec49045bf50a78c5f7643e7f1ba3c030.jpg',
             'Width': 800}],
 'postal_code': '31702',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Niedersachsen',
 'region_code': 'DE-NI',
 'registration_date': '2016-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-04-27 08:15:09 [auto1.de] INFO: Saving data for LL59024: {'created_time': 1777277709.727846, 'last_price_update_time': 1777277709.727859, 'has_photos': True, 'auction_closing_time': 1777391053.0}
2026-04-27 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_ae8dc9dc5f6456c537522e5ff20567af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_7dba3d710bc210b3a52ae52bf827b6d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_c0a94ff167f0c43c8e08e58d3c4f0939.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fcff6d22ec18d899eb67ca3e6c7dfec2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_7c86a0524246d86f8ea8beda6655fc56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3025ba10>
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_ae8dc9dc5f6456c537522e5ff20567af.jpg saved to cache
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cda390>
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_7dba3d710bc210b3a52ae52bf827b6d2.jpg saved to cache
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc0e50>
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_c0a94ff167f0c43c8e08e58d3c4f0939.jpg saved to cache
2026-04-27 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d30057f50>
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fcff6d22ec18d899eb67ca3e6c7dfec2.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 283b5831-7161-5609-a054-c35120bd52ec
2026-04-27 08:15:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 283b5831-7161-5609-a054-c35120bd52ec, skipping ID generation
2026-04-27 08:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 1
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 283b5831-7161-5609-a054-c35120bd52ec sending to next pipeline
2026-04-27 08:15:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 283b5831-7161-5609-a054-c35120bd52ec, identifier: PT52067
2026-04-27 08:15:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-04-27 08:15:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-04-27 08:15:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067 to the API
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fcff6d22ec18d899eb67ca3e6c7dfec2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'city': 'Kippenheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-04-28T15:30:00Z',
 'fuel_type': 'diesel',
 'id': '283b5831-7161-5609-a054-c35120bd52ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.2956,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT52067',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'location_confidence': 'geocoded',
 'longitude': 7.8251,
 'make': 'BMW',
 'model': '4er',
 'odometer': 246115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fe24376c7df79aa3c8a7893e0693da96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fcff6d22ec18d899eb67ca3e6c7dfec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_c0a94ff167f0c43c8e08e58d3c4f0939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_7dba3d710bc210b3a52ae52bf827b6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_add4886822770ebd0f9b3561289e56a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_df6472d47770de9f48916a8d11b13022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_ae8dc9dc5f6456c537522e5ff20567af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_a37c1743661b7eb3ce12148a79add575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_fa97f6fb0ab415dd503cd3b66e94df3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_283b5831-7161-5609-a054-c35120bd52ec/283b5831-7161-5609-a054-c35120bd52ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bd/16bd4d547a4ce3a6cf53559316fdd08f/pa/PT52067_4faefb40098bb3ce2850d72f9bd41244.jpg',
             'Width': 800}],
 'postal_code': '77971',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Freiburg Region',
 'province_code': 'DE-083',
 'region': 'Baden-Württemberg',
 'region_code': 'DE-BW',
 'registration_date': '2018-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2018}
2026-04-27 08:15:10 [auto1.de] INFO: Saving data for PT52067: {'created_time': 1777277710.436045, 'last_price_update_time': 1777277710.436056, 'has_photos': True, 'auction_closing_time': 1777390200.0}
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_adab44943d2b1ecb0c7025f89e1fdeb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_cfaa1a5bb8bb02558109b58340d784e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_f3d0bd0a377ffb690e2399c8e3324062.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b065def8000f19834dfddafeab381a4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22cc1c50>
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_7c86a0524246d86f8ea8beda6655fc56.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_988b0f6ffd11c41543734a30b993b543.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22d60f10>
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_adab44943d2b1ecb0c7025f89e1fdeb6.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22eaa950>
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_cfaa1a5bb8bb02558109b58340d784e6.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_7475e77401631f6bd4674bc301fe37cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_88bacebfc3dfd7d18d08f2f85eaeba76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22b748d0>
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_f3d0bd0a377ffb690e2399c8e3324062.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3004d390>
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b065def8000f19834dfddafeab381a4d.jpg saved to cache
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4
2026-04-27 08:15:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4, skipping ID generation
2026-04-27 08:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with scrape type 1
2026-04-27 08:15:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 sending to next pipeline
2026-04-27 08:15:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4, identifier: UB07132
2026-04-27 08:15:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-04-27 08:15:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-04-27 08:15:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132 to the API
2026-04-27 08:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b065def8000f19834dfddafeab381a4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'city': 'Seddiner See',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-04-28T15:52:30Z',
 'fuel_type': 'petrol',
 'id': '1e9076f6-5662-5346-b9ed-fe5c2d6183a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 52.2722,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB07132',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'location_confidence': 'geocoded',
 'longitude': 13.0167,
 'make': 'Mazda',
 'model': '5',
 'odometer': 208542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_7c86a0524246d86f8ea8beda6655fc56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d268ce06d98242859f5894ebed1f1041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_ecdab7d4c24ef6e8fe238151a03d4c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_cfaa1a5bb8bb02558109b58340d784e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b065def8000f19834dfddafeab381a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_02e4eb4a6fd7ef975c2ffcb0a12840a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d5bd234762042621b05392f31b53fa10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_b12780645a31101b8d4f4873b3930546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_e398dbf34b96a538d081055dc3cb6a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e9076f6-5662-5346-b9ed-fe5c2d6183a4/1e9076f6-5662-5346-b9ed-fe5c2d6183a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/35/6135e648cea8b86ed9284fef941fad3d/pa/UB07132_d4eea3aa5f9c34dfbbb74607ec11341d.jpg',
             'Width': 800}],
 'postal_code': '14554',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Brandenburg',
 'region_code': 'DE-BB',
 'registration_date': '2011-06-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 5 1.8 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2011}
2026-04-27 08:15:11 [auto1.de] INFO: Saving data for UB07132: {'created_time': 1777277711.737701, 'last_price_update_time': 1777277711.737711, 'has_photos': True, 'auction_closing_time': 1777391550.0}
2026-04-27 08:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_8c1f07e54b637cc76c4fd9a71f8bc171.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_a152fb861ee3e181024b0059e8162998.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ee4310>
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_988b0f6ffd11c41543734a30b993b543.jpg saved to cache
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d3006fd90>
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_7475e77401631f6bd4674bc301fe37cd.jpg saved to cache
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a54bd0>
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_88bacebfc3dfd7d18d08f2f85eaeba76.jpg saved to cache
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_829ceb5355ab259be73e3aba2d75b112.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22a4a710>
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_8c1f07e54b637cc76c4fd9a71f8bc171.jpg saved to cache
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f29c10>
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_a152fb861ee3e181024b0059e8162998.jpg saved to cache
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 007deb63-0da1-5cc0-94bf-5464273ece29
2026-04-27 08:15:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 007deb63-0da1-5cc0-94bf-5464273ece29, skipping ID generation
2026-04-27 08:15:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007deb63-0da1-5cc0-94bf-5464273ece29 with scrape type 1
2026-04-27 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 007deb63-0da1-5cc0-94bf-5464273ece29 sending to next pipeline
2026-04-27 08:15:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 007deb63-0da1-5cc0-94bf-5464273ece29, identifier: LJ19691
2026-04-27 08:15:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-04-27 08:15:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-04-27 08:15:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691 to the API
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_a152fb861ee3e181024b0059e8162998.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'city': 'Karlskron',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-04-28T15:10:27Z',
 'fuel_type': 'petrol',
 'id': '007deb63-0da1-5cc0-94bf-5464273ece29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 48.6833,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ19691',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'location_confidence': 'geocoded',
 'longitude': 11.4167,
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 80659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_988b0f6ffd11c41543734a30b993b543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_8c1f07e54b637cc76c4fd9a71f8bc171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_1f3bad03f1e3f7f70a6be02230ea7e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_a152fb861ee3e181024b0059e8162998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_f3d0bd0a377ffb690e2399c8e3324062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_adab44943d2b1ecb0c7025f89e1fdeb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_346fe55ab3834f739da3bef5ec451565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_62ca33d307fde56ec23d305284f3b731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_384892d4b45fbeb6189c818b194329fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_007deb63-0da1-5cc0-94bf-5464273ece29/007deb63-0da1-5cc0-94bf-5464273ece29_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/b3/ebb37be319f3d6e8510cb081b64d1ed4/pa/LJ19691_56d953adb58863db9b6bb60e155e162c.jpg',
             'Width': 800}],
 'postal_code': '85123',
 'price': 0,
 'price_includes_vat': True,
 'province': 'Upper Bavaria',
 'province_code': 'DE-091',
 'region': 'Bayern',
 'region_code': 'DE-BY',
 'registration_date': '2017-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-04-27 08:15:12 [auto1.de] INFO: Saving data for LJ19691: {'created_time': 1777277712.383873, 'last_price_update_time': 1777277712.383883, 'has_photos': True, 'auction_closing_time': 1777389027.0}
2026-04-27 08:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22ae75d0>
2026-04-27 08:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_829ceb5355ab259be73e3aba2d75b112.jpg saved to cache
2026-04-27 08:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57e387b3-e57a-588c-a9e3-6b18ce566e22
2026-04-27 08:15:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57e387b3-e57a-588c-a9e3-6b18ce566e22, skipping ID generation
2026-04-27 08:15:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e387b3-e57a-588c-a9e3-6b18ce566e22 with scrape type 1
2026-04-27 08:15:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57e387b3-e57a-588c-a9e3-6b18ce566e22 sending to next pipeline
2026-04-27 08:15:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e387b3-e57a-588c-a9e3-6b18ce566e22, identifier: YR53250
2026-04-27 08:15:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-04-27 08:15:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-04-27 08:15:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:15:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250 to the API
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:15:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_829ceb5355ab259be73e3aba2d75b112.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'city': 'Germersheim',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-04-28T15:04:43Z',
 'fuel_type': 'diesel',
 'id': '57e387b3-e57a-588c-a9e3-6b18ce566e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'latitude': 49.2231,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR53250',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'location_confidence': 'geocoded',
 'longitude': 8.3639,
 'make': 'Audi',
 'model': 'A4',
 'odometer': 271776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_829ceb5355ab259be73e3aba2d75b112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_88bacebfc3dfd7d18d08f2f85eaeba76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_7475e77401631f6bd4674bc301fe37cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_4d5f5220a8733834a351b7a5b43c2577.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57e387b3-e57a-588c-a9e3-6b18ce566e22/57e387b3-e57a-588c-a9e3-6b18ce566e22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/19/9119629ec9281751a9bfa3c1c64437f7/pa/YR53250_99357360de1d70fb38ef6e3c689240ee.jpg',
             'Width': 800}],
 'postal_code': '76726',
 'price': 0,
 'price_includes_vat': True,
 'province': None,
 'province_code': 'DE-00',
 'region': 'Rheinland-Pfalz',
 'region_code': 'DE-RP',
 'registration_date': '2005-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-04-27 08:15:12 [auto1.de] INFO: Saving data for YR53250: {'created_time': 1777277712.844228, 'last_price_update_time': 1777277712.844238, 'has_photos': True, 'auction_closing_time': 1777388683.0}
2026-04-27 08:15:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.720(s), this was the 1st time calling it.
2026-04-27 08:15:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.650256594836249 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG14564> (referer: https://www.auto1.com/v1/car-details-view/VG14564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with identifier: VG14564
2026-04-27 08:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with scrape type 1
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f73a1a49-e8ed-5358-8e20-a7b4ef063ecc
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_d2f144c0b339fdb72736bd5c9d111ad1.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_6cb3bca863b3da13e97f98c9475aa5e5.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_e9c4898640815589d972c9a511adf463.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_df461893de7d462bfc75d6a6152d7ad2.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_0d94cee0b5fc51ae4b553157287f69d3.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_117fd03787508d91197f15012e4f7e9f.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_0e709da05a5e04ad2ee89b84b3dfe27d.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_554de0c72662fc934260f52561dff6e5.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_7829396fcc2f8ab3f282abf670fe07cf.jpg not downloaded yet
2026-04-27 08:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_f1fd1aa760ca2835dba1c21e2a720d36.jpg not downloaded yet
2026-04-27 08:15:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT63748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:15:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_f1fd1aa760ca2835dba1c21e2a720d36.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6d22f2af10>
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:15:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73a1a49-e8ed-5358-8e20-a7b4ef063ecc/f73a1a49-e8ed-5358-8e20-a7b4ef063ecc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d4/34d4ba307b035a119b2835ae3d485c63/pa/VG14564_f1fd1aa760ca2835dba1c21e2a720d36.jpg saved to cache
2026-04-27 08:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f73a1a49-e8ed-5358-8e20-a7b4ef063ecc
2026-04-27 08:15:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.122(s), this was the 1st time calling it.
2026-04-27 08:15:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.674668810535626 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:43 [scrapy.extensions.logstats] INFO: Crawled 768 pages (at 30 pages/min), scraped 350 items (at 15 items/min)
2026-04-27 08:15:43 [scrapy.extensions.memusage] INFO: Peak memory usage is 386MiB